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ABSTRACT 

This  thesis  describes  the  Department  of  the  Army  (DA) 
Financial  Management  Quality  Assurance  Program,  the  Finance 
Information  Network  Evaluation  System  and  the  Finance  and 
Accounting  Monthly  Operations  Report  System.   Sample  perfor- 
mance data  from  Finance  and  Accounting  Offices  (FAOs)  are 
used  to  develop  methodologies  for  identifying  substandard 
performance;  to  determine  the  effect  of  the  (DA)  Quality 
Assurance  assistance  visits  on  FAO  performance;  and  to 
develop  a  current  profile  of  the  performances  of  the  various 
DA  FAOs  in  regards  to  the  Joint  Uniform  Military  Pay  System 
(JUMPS).   Additionally,  recommendations  for  improvement  of 
the  DA  Financial  Management  Quality  Assurance  Program  are 
presented.   Two  of  these  recommendations  involve  how  to 
develop  DA  and  major  command  historical  performance  stan- 
dards, and  ways  to  identify  substandard  performances  by  FAOs 
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I.   INTRODUCTION 

A.   DESCRIPTION  OF  THE  PROBLEM 

In  January  1981  the  Commander  of  the  United  States  Army 

Finance  and  Accounting  Center  (USAFAC)  stated  that  it  was 

unable  to  properly  ascertain  the  effectiveness  of  resource 

utilization  at  the  major  command  and  installation  levels  due 

to  the  lack  of  an  adequate  finance  operations  reporting 

system  [Ref.  1].   To  alleviate  this  problem  the  Comptroller 

of  the  Army  (COA),  the  proponent  for  the  Department  of  the 

Army  (DA)  financial  management  systems,  has  recently 

developed  a  series  of  operational  reports  entitled  Finance 

and  Accounting  Monthly  Operations  Report  (FINOPS)  and 

Financial  Information  Network  Evaluation  System  (FINES)  [Ref. 

1].   Major  General  R.  G.  Fazakerley  USA,  the  former  Assistant 

Comptroller  of  the  Army  for  Finance  and  Accounting  (A COA 

(F&A)) ,  stated: 

"My  responsibilities  include  monitoring  the  effectiveness 
of  field  finance  and  accounting  offices,  exercising  overall 
technical  supervision  of  the  Army -wide  finance  and 
accounting  network,  providing  adequate  and  timely  finance 
and  accounting  services  to  the  Army,  and  monitoring  the 
training  of  both  civilian  and  military  members  within  the 
Army  school  system  to  ensure  sufficient  members  of  trained 
personnel  are  available  to  staff  the  network.   Each  of 
these  responsibilities  entails  the  expenditure  of  resources 
and  it  is  incumbent  upon  managers  at  every  level  to  use 
these  resources  wisely  for  the  good  of  the  Army.   To 
provide  the  commander  and  his  resource  manager  with  useful 
information,  and  to  assist  me  in  fulfilling  my  responsibil- 
ities, I  am  proposing  a  more  effective  flow  of  information 
be  established  between  field  finance  offices,  installation 
managers,  major  commands,  and  USAFAC."  [Ref.  1] 
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The  new  information  systems  are  designed  to  improve  the  flow 
of  management  information  within  the  finance  and  accounting 
network,  providing  improved  capability  for  the  accurate 
assessment  of  operational  effectiveness  of  DA  finance  and 
accounting  activities.   According  to  Major  General  D.  P. 
Burns  USA,  the  ACOA  (F&A),  a  method  for  assessing  the 
performance  of  installation  Finance  and  Accounting  Offices 
(FAOs)  is  required  by  the  Director  for  Quality,  USAFAC  which 
can  be  used  to  determine  the  magnitude  and  directional 
emphasis  of  the  Financial  Management  Quality  Assurance 
Program  [Ref.  2]. 

B.   THESIS  OBJECTIVE 

The  USAFAC  Office  of  Field  Evaluation/Analysis  (OFEA) 
requested  the  authors  to  conduct  an  analysis  to  assist  in  the 
determination  of  the  magnitude  and  directional  emphasis  of 
the  DA  Financial  Management  Quality  Assurance  (QA)  Program. 
The  specific  objectives  of  this  thesis  are  therefore  to: 

1.  Develop  a  methodology  for  identifying  substandard 
performance  of  DA  FAOs. 

2.  Perform  tests  for  assessing  the  effectiveness  of  DA  QA 
assistance  visits  to  field  FAOs. 

3.  Develop  a  method  which  will  enable  the  Director  for 
Quality,  USAFAC,  to  assess  the  current  health  of  the 
total  DA  financial  network. 

4.  Make  recommendations  for  improvements  to  the  DA  QA 
Pr  ogr  am. 
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C.   METHODOLOGY 

Research  for  developing  the  analysis  of  performance 
evaluators  was  accomplished  by  a  literature  search  of 
journals,  periodicals,  and  books,  and  by  interviews  with 
personnel  in  OFEA,  USAFAC.   The  search  also  attempted  to 
identify  the  financial  management  reporting  systems  currently 
being  used  by  USAFAC  and  its  subordinate  FAOs. 

Analyses,  including  probability  distribution  theory, 
analysis  of  variances  and  graphical  presentation,  were 
conducted  on  a  sample  of  the  DA  FAO ' s  Joint  Uniform  Military 
Pay  System  (JUMPS)  performance  data  for  the  18  month  period 
of  January  1980  to  June  1981.   These  analyses  were  accom- 
plished in  order  to  establish  standards  and  measure  current 
performance  in  terms  of  these  standards.   Additionally,  these 
analyses  assessed  the  impact  of  DA  QA  assistance  visits  on 
JUMPS  transactions  performance  indicators.   Data  was  gathered 
through  the  FINES,  FINOPS  and  the  JUMPS-Army  Status  Reports. 
Conclusions  were  drawn  as  to  the  validity  and  utility  of  the 
methodologies  for  assessing  substandard  performance  in  the 
JUMPS  system  and  the  impact  of  the  DA  QA  assistance  visits. 
Finally,  based  on  the  relationship  between  JUMPS  and  other  DA 
fiscal  systems,  recommendations  for  improvements  to  the 
overall  DA  QA  Program  were  offered. 
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D.   THESIS  ORGANIZATION 

Chapter  II  provides  an    overview  of  the  concepts  of 
management  control  and  quality  control  and  their  relationship 
to  the  DA  Quality  Assurance  Program.   A  brief  overview  of  the 
Air  Force  Quality  Assurance  Program  and  its  key  features  is 
provided  for  comparison.   This  action  is  taken  to  set  the 
stage  for  later  chapters.   Additionally,  Chapter  II  provides 
an  overview  of  the  organization  and  functions  of  the  DA 
financial  management  network. 

Chapter  III  presents  a  description  of  the  two  recently 
developed  operational  reports:   FINOPS  and  FINES.   FINOPS 
provides  data  through  command  channels  to  USAFAC,  which  is 
the  basis  for  manangement  to  ascertain  the  overall  perfor- 
mance of  the  DA's  world-wide  financial  network.   FINES  is  a 
management  information  system  within  USAFAC  which  assimilates 
quality  and  quantity  performance  data  on  field  finance 
operations  with  data  provided  by  FINOPS.   Additionally, 
Chapter  III  presents  the  key  evaluators  utilized  to  assess 
the  information  provided  by  FINOPS. 

Chapter  IV  provides  an  analysis  of  a  selected  sample  of 
the  JUMPS  data  submitted  by  the  reports  discussed  in  Chapter 
III,  and  presents  methods  developed  by  the  authors,  for 
evaluating  performance  by  various  FAOs.   Statistical  analyses 
in  this  chapter  was  facilitated  through  the  utilization  of 
the  MINITAB  statistical  program.  [Ref.  3] 

Chapter  V  presents  the  conclusions  and  recommendations  o^ 

this  thesis. 
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II .   BACKGROUND  AND  PURPOSE  OF  QUALITY  ASSURANCE 

A.   INTRODUCTION 

In  order  to  accomplish  the  stated  objectives  of  this 
thesis,  it  is  necessary  to  first  provide  the  reader  with 
background  material  on  the  organizations  and  functions  of  the 
Department  of  the  Army  (DA)  financial  network.   This  chapter 
will  describe  the  United  States  Army  and  United  States  Air 
Force  Quality  Assurance  Programs  to  provide  the  reader  with 
the  perspective  necessary  to  understand  the  various  aspects 
of  the  financial  management  control  systems  to  be  discussed 
in  Chapter  III. 

The  authors  contend  that  the  effective  management  of 
financial  resources  requires  a  multitude  of  managerial, 
operational  and  quality  controls.   Harvard  University's 
Robert  Anthony,  a  renowned  academician  in  the  field  of 
financial  management,  stated  that  "management  control  is  a 
process  by  which  managers  assure  that  resources  are  obtained 
and  used  effectively  and  efficiently  in  the  accomplishment  of 
an  organization's  objectives"  [Ref  4:   p.  452]. 
Additionally,  he  stated  that  the  purpose  of  a  management 
control  system  is  to  encourage  managers  to  take  actions  which 
are  in  the  best  interest  of  the  organization,  with  emphasis 
on  psychological/ behavioral  considerations  or  factors.   The 
control  system  can  therefore  be  thought  of  as  a  "tool"  which 
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when  used  properly,  will  aid  in  focussing  personnel  energies 
toward  achieving  organizational  objectives. 

Control  systems  cause  individuals  to  direct  attention 
and  personnel  energies  toward  those  items  or  areas  included 
in  the  control  system.   Ideally,  these  energies  should  be 
directed  toward  performance  improvement.   However,  efforts 
are  frequently  directed  toward  beating  the  system,  manipula- 
tion of  measures,  game  playing,  sabotaging  and  the  setting  of 
low  standards  and  goals  [Ref.  5:   p.  68].   An  individual's 
perception  of  management's  use  of  the  control  system  is 
important.  It  is  helpful  to  utilize  input  solicited  or 
provided  by  the  individuals  in  selecting  the  areas  to  be 
measured  by    the  control  system  [Ref.  6:   p.  207]. 

One  aspect  of  management  of  financial  resources  is  that 
of  quality  control,  which  can  be  defined  as  "the  process 
through  which  we  measure  actual  quality  performance,  compare 
it  with  standards,  and  act  on  the  difference"  [Ref.  7:  p.  3]. 
From  this  quote  taken  from  Juran  and  Gryna,  it  can  be  seen 
that  setting  the  standards  is  a  very  important  factor  in  this 
process.   Goals  and  standards  should  be  attainable,  but  must 
also  be  challenging  to  the  individuals  or  organization  [Ref. 
3:   p.  29]. 

Quality  control  has  taken  several  shapes  in  the  past 
three  decades.   The  1950  '  s  were  marked  by  a  trend  toward  the 
utilization  of  complex  systems,  such  as  computers  and  aero- 
space systems.   The  increased  use  of  these  systems  brought 
about  unacceptable  field  failure  rates  and  a  subsequent 
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questioning  of  the  reliability  of   these  complex  systems 
[Ref.  7:   p.  559].   An  occupational  specialty  known  as 
reliability  engineering  emerged.   The  specialists,  known  as 
reliability  engineers,  minimized  the  field  failure  rates 
through  the  use  of  statistical  methods  such  as  reliability 
and  hypothesis  testing.   Zero  Defects,  a  motivational 
approach  to  eliminate  defects  attributable  to  human  error, 
gained  popularity  in  the  1960's  among  industrial  and 
governmental  activities.   The  Department  of  Defense  Zero 
Defects  Program  was  designed  to  motivate  all  persons  directly 
or  indirectly  involved  in  the  national  defense  effort  to  do 
their  jobs  right  the  first  time,  and  everytime  [Ref.  9:   p. 
3].   The  program  was  an    appeal  to  the  individual's  pride  of 
workmanship,  in  which  managerial  and  employee  motivation 
played  a  key  role.   The  1970  '  s  brought  about  further  develop- 
ments in  the  human  factors  of  production  performance,  and  the 
organizational  development  and  the  behavioral  aspects  of  man 
and  machine  interaction  in  production  or  operations.   The 
human  factor  approach  aided  in  the  improvement  of  quality  by 
reducing  human  errors  [Ref.  5:   p.  12]. 

"Quality"  may  be  a  difficult  term  to  describe  accurately 
for  the  authors,  due  to  its  inexactness.   In  one  sense,  the 
"quality"  of  a  product  or  service  can  best  be  judged  by  the 
user  or  recipient,  depending  on  the  degree  to  which  the 
product  or  service  meets  the  needs  of  the  user.   A  very  basic 
definition  of  quality  is,  "fitness  for  use"  [Ref.  7:   p.  1]. 
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Two  parameters  to  the  fitness  for  use  concept  are  the  quality 
of  design  and  quality  of  conformance.   The  quality  of  design 
addresses  the  variations  in  levels  of  fitness  or  grades, 
whereas  quality  conformance  deals  with  the  product's 
conformity  to  the  intent  of  the  design  or  the  extent  to  which 
it  meets  the  design  standards.   Acceptable  quality  is  "a 
function  of  the  extent  to  which  the  product's  quality 
characteristics  meet  the  standards  established  in  light  of 
the  customer's  satisfaction"  [Ref.  6:  p. 16]. 

One  method  managers  have  utilized  in  maintaining  an 
assurance  that  quality  products/service  have  been  provided  is 
through  the  independent  audit  function,  external  and 
internal.   In  the  government  this  independent  audit  became 
known  as  the  quality  audit  and  subsequently  quality 
assurance.  Juran  defined  quality  assurance  as  "the  activity 
of  providing  to  all  concerned  the  evidence  needed  to 
establish  confidence  that  the  quality  function  is  being 
performed  adequately"  [Ref.  7:   p  2].   The  DA  financial 
management  quality  assurance  philosophy  is  that  the  function 
should  be  performed  by  an  organizational  element  under  the 
direct  supervision  of    the  individual  responsible  for  the 
management  of  the  financial  resources.    [Ref.  10:   p.  5] 
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B.   ORGANIZATION  &    FUNCTIONS  OF  THE  ARMY  FINANCIAL  NETWORK 

The  authors  feel  that  it  is  difficult  to  discuss  the  DA 
financial  management  quality  assurance  program  and  the 
responsible  organizational  entities  without  first  looking  at 
the  various  organizational  elements  involved  in  the  technical 
and  hierarchial  structure  of  DA  financial  management.   It 
should  be  realized  that  the  lines  of  technical  communication 
depicted  herein  do  not  necessarily  coincide  with  military 
chain  of  command  channels. 

1.   Comptroller  of  the  Army 

The  Comptroller  of  the  Army  (COA)  is  directly 
responsible  to  and  under  the  supervision  of  the  Assistant 
Secretary  of  the  Army  (Installation  Logistics  &  Financial 
Management),  (ASA(IL&FM))  for  financial  management  guidance. 
The  COA  has  concurrent  responsiblities  to  the  Army  Chief  of 
Staff,  and  has  general  staff  responsibilities  in  the 
following  basic  areas: 

a.  Independent  review  and  analysis  of  DA  programs  and  an 
analysis  of  major  DA  command  programs. 

b.  Accounting,  fiscal,  audit,  budgetary,  progress  and 
statistical  reporting,  report  control,  cost  analysis, 
and  management  analysis  activities  of  the  DA. 

c.  Data  processing  systems  in  support  of  all  assigned 
functional  areas  of  responsibility. 

d.  Continuing  and  independent  analysis  of  DA  organiza- 
tions, functions,  and  procedures. 

e.  Review  and  analysis  of  the  existing  DA  management 
system,  and  the  development  of  any  new  DA-wide 
management  systems  which  do  not  fall  within  the 
functional  area  of  responsibility  of  any  single  DA 
staff  agency  or  element  [Ref.   11]. 
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2.   'Major  Commands 

The  DA  is  organized  into  commands  which  have 
distinct  missions,  all  of  which  contribute  to  the  overall 
mission  of  preparing  the  land  forces  for  combat.   These 
commands  are  called  Major  Commands  (MACOMs).   The  MACOMs  for 
the  purpose  of  this  thesis  will  be  in  two  major  categories; 
Continental  United  States  (CONUS)  and  Overseas.   Overseas 
major  commands  include  United  States  Army -Europe  (USAREUR), 
Eighth  United  States  Army,  United  States  Army-Japan,  and 
Western  Command. 

CONUS  major  commands  include  U.S.  Army  Forces 
Command  (FORSCOM),  U.S.  Army  Training  and  Doctrine  Command 
(TRADOC),  U.S.   Army  Materiel  Development  and  Readiness 
Command,  U.S.  Army  Health  Services  Command,  and  U.S.  Army 
Communications  Command.   Brief  descriptions  of  the  CONUS 
major  commands  are  in  Table  II-l. 

The  three  major  commands  of  primary  interest  for 
future  analyses  in  this  thesis  are  FORSCOM,  TRADOC,  and 
USAREUR.   The  authors  feel  that  these  MACOMs  are  representa- 
tive of  the  DA.   FORSCOM,  headquartered  at  Fort  McPherson  in 
Atlanta,  Georgia  is  the  organization  comprised  of  the  Army's 
fighting  forces,  such  as  the  9th  Infantry  Division,  Fort 
Lewis,  Washington,  and  the  32nd  Airborne  Division,  Fort 
Bragg,  North  Carolina.   Altogether,  FORSCOM  commands  the  ten 
CONUS-based  combat  divisions,  ten  brigade  sized  combat  units, 
and  nine  Army  Readiness  Regions  (reserves). 
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The  Training  and  Doctrine  Command  is  comprised  of 
schools  and  training  centers,  including  individual  basic 
skill  training  facilities  at  Fort  Benning,  Georgia  and  Fort 
Leonard  Wood,  Missouri  and  advanced  schooling  facilities  such 
as  the  Command  and  General  Staff  College  Fort  Leavenworth, 
Kansas  and  the  DA's  Senior  Service  School  (The  Army  War 
College)  at  Carlisle  Barracks,  Pennsylvania.   Doctrinal 
developments  are  carried  out  at  the  TRADOC  headquarters  at 
Fort  Monroe,  Virginia  and  the  three  mid-management  centers, 
the  Combined  Arms  Center,  Fort  Leavenworth,  Kansas,  the 
Logistics  Center,  Fort  Lee,  Virginia,  and  the  Soldier  Support 
Center  at  Fort  Benjamin  Harrison,  Indiana. 

The  MACOMs'  role  in  financial  management  is  essentially 
that  of  distributors  rather  than  consumers  of  funds.   The 
MACOMs  are  the  organizational  interface  between  the  DA  staff 
and  subordinate  installations  for  the  programming  and  budget- 
ing system,  and  for  monitoring,  analyzing,  and  coordinating 
the  budget  formulation  and  execution  of  the  subordinate 
activities/installations.   There  are  generally  two  configura- 
tions for  performing  this  role,  the  traditional  Comptroller 
and  the  increasingly  popular  Resource  Management  concept. 

The  Resource  Management  concept  recognizes  the  broad 
scope  of  comptr ol 1 er shi p  functions  and  interrelationships  by 
including  additional  aspects  of  resource  management,  such  as 
force  management.   Typically,  at  the  MACOM  level,  the  Deputy 
Chief  of  Staff  for  Resource  Management  has  functional 
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TABLE  II -1 
PRINCIPAL  CONUS  MAJOR  COMMANDS 


Name 

U.S.  Army  Materiel 
Development  and  Readiness 
Command 


U.S.  Army  Forces 
Command 


U.S.  Army  Health 
Services  Command 


U.S.  Army  Training 
and  Doctrine  Command 


U.S.  Army  Communications 
Command 


Function 

Responsible  for   developing  and 
providing  materiel    and   related 
services  to  Army  activities   and 
installations;  directing  and 
improving  performance  of  whole- 
sale materiel    and   supply 
activities  ;  supply  and  mainten- 
ance support  to  Army  commands 
and  authorized  foreign 
customers. 

Direct  and  supervise  CONUS 
based  Strategic  Armed  Forces, 
Army  National   Guard  and  Army 
Reserve  unit's  training;  serve 
as  the  Army  component  of  the 
U.S.   Readiness  Command;  command 
forces  oriented  installations. 

Responsible  for  providing  all 
matters  of  health  services  to 
Army  personnel,  dependents  and 
retirees;  command  health 
service  oriented  activities. 

Responsible  for  individual 
training,  education  and 
doctrinal  development ;  manage 
Reserve  Officer  Training  Corps 
programs;  command  training 
oriented  installations  and 
doctrinal  development 
activities. 

Plan,  engineer,  install, 
operate,  and  maintain  Army 
fixed  communications  systems; 
develop  doctrine  for  communi- 
cations. 
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responsibilities  in  management  analysis,  budgeting,  finance, 
cost  analysis  and  force  managment.   The  inclusion  of  force 
management  recognizes  the  resource  implications  of  changes  to 
the  force  structure  and  manpower  documents.   The 
Headquarters,  Training  and  Doctrine  Command  is  organized 
utilizing  the  Resource  Management  concept,  whereas 
Headquarters,  Forces  Command  and  Headquarters,  Materiel 
Development  and  Readiness  Command  utilize  the  Deputy  Chief  of 
Staff,  Comptroller  configuration  in  their  performance  of  the 
MACOM  role. 

3.   The  Finance  and  Accounting  Office  (FAQ) 

Installations  are    responsible  to  MACOMs  whose 
missions  most  closely  coincide  with  the  mission  and  functions 
of  the  installations.   For  example,  an  installation  whose 
major  function  is  strategic  and  supports  a  strategic  unit 
(e.g.  an  Infantry  Division)  would  be  subordinate  to  the  MACOM 
whose  mission  includes  strategic  forces:   FORSCOM.   The 
command  structure  can  in  actuality  be  much  more  complicated 
since  there  are    many  multi-purpose  installations,  however  for 
the  purpose  of  this  thesis,  the  simplified  interpretation 
wi  1  1  suf f i ce . 

Each  installation  is  supported  for  financial 
administration  by  a  finance  and  accounting  operation,  such  as 
a  FAO.   It  must  be  recognized  that  because  of  varying 
missions,  degrees  of  automation,  etc.,  not  all  finance  and 
accounting  operations  ar e  exactly  alike.   The  description  of 
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the  following  FAO  is  meant  to  be  representative  of  what  the 
reader  might  expect  to  find  at  a  typical  installation  in 
CONUS: 

a.  Command  Responsibility 

The  FAO  Officer  is  under  the  direct  staff 
supervision  of  the  Comptroller,  wKo  is  a  member  of  the 
general  staff. 

b .  Mission 

The  mission  of  the  FAO  is  to  provide  financial 
service  to  the  installation  and  activities  it  serves.   In 
providing  this  service,  it  carries  out  the  following  major 
f unct i  ons : 

1.  Prepares,  completes,  and/or  certifies  civilian  and 
military  payrolls;  travel,  commercial,  and  other 
vouchers  or  claims  for  payment. 

2 .  Disburses  funds  by  either  cash  or  check,  and  issues 
savings  bonds. 

3.  Performs  financial  accounting  for  the  installation, 
including  consumer  fund  and  financial  property 
accounting. 

4.  Provides  financial  data  and  advice;  assists  in 
preparing  estimates,  recommendations,  plans,  reports 
relating  to  financial  matters. 

5.  Maintains  control  of  installation  funds. 
[Ref.  11:   p.   C-l]. 

c.  Organization  Army  Regulation  (AR)  37-101  provides 
that  the  FAO  will  be  organized  to  identify  the  functional 
responsibilities  of  each  segment  of  the  organization  and  to 
provide  a  system  of  internal  control.   The  fundamental 
internal  control  principles  which  separate  the  basic 
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functions  of  voucher  preparation,  custody  of  cash,  and 
accounting  must  be  followed.  As  illustrated  in  Figure  II-l, 
the  FAO  is  composed  of  one  Administrative  Section,  a  Central 
Accounting  Office  and  six  branches  under  the  supervision  of 
the  FAO  Officer . 

This  brief  description  typifies  an  "integrated"  FAO.   A 
more  in-depth  look  at  the  functional  relationships  and 
responsibilities  of  the  FAO  can  be  found  in  Appendix  A.   A 
common  variation  of  this  configuration  is  the  "non-integra- 
ted" finance  office.   Its  mission  is  to  provide  financial 
service  to  combat  or  tactical  units,  and  its  major  functions 
are  therefore  restricted  to  those  of  Military  Pay,  Travel, 
Quality  Edit,  Disbursing,  Quality  Assurance  and  Data 
.  Conversion.   Accounting  support  is  normally  provided  by  a 
regional  accounting  office  or  a  supporting  installation  FAO. 
Other  finance  operations  whose  missions  are    to  provide  on  the 
spot  financial  support  to  small  units  or  activities  in  the 
Military  Pay,  Disbursing  and  Travel  functional  areas,  are  the 
Forward  Support  Team  and  Class  "B"  Agent  Office. 

Operational  reporting  requirements  may  vary  greatly  among 
these  various  types  of  operations  due  to  their  functional 
differences.   Although  fiduciary  reports  are  sent  directly 
from  the  activity  to  the  United  States  Army  Finance  and 
Accounting  Center  (USAFAC)  by  the  reporting  office,  the  typi- 
cal reporting  channels  from  the  lowest  to  the  highest  eche- 
lons of  financial  operations  would  be  from  the  Class  "3"  Agent 
to  the  parent  FAO,  through  the  MACOM  and  finally  to  USAFAC. 
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The  functions,  responsibilities,  and  account ibility  of 
the  FAOs  are  founded  and  legitimatized  by  public  law  and 
decisions  of  the  United  States  Comptroller  General.   The  DA 
financial  management  system  and  the  or gani zat i on ( s)  designed 
to  carry  out  the  functions  and  responsibilities  are  quite 
explicitly  stated  in  the  applicable  DA  regulations. 

C.   THE  ARMY  FINANCIAL  MANAGEMENT  QUALITY  ASSURANCE  PROGRAM 

AR  11-37  prescribes  the  policy,  responsibilities, 
procedures  and  reporting  requirements  of  the  DA-wide  Finance 
and  Accounting  Quality  Assurance  Program.   The  primary 
purposes  of  the  DA  program  are  to  help  identify  potential 
problem  areas,  clarify  procedures,  and  identify  activities 
responsible  for  corrective  action  to  be  taken.   This  regula- 
tion defines  "Quality  Assurance  Program"  as  "a  written,  time 
phased  plan  to  improve  the  quality,  accuracy,  and  timeliness 
of  financial  services  A  r  my -wide"  [Ref.  10:   p.   2  ] .   The  plan 
refers  to  all  phases  of  financial  operations  including 
accounting  of  appropriated  and  nonappropriated  funds, 
Military  Pay  and  Allowances,  Civilian  Pay  and  Allowances, 
Disbursing  Operations,  Travel  and  Transportation  Allowances, 
Commercial  Accounts,  and  the  payment  and  administration  of 
the  Reserve  Component's  inactive  duty.   The  objectives  of  the 
program  set  forth  by  the  regulation  are  to: 

1.   improve  the  quality,  accuracy,  and  timeliness  of 
financial  services. 
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2.  prevent  the  loss  or  misuse  of  money,  material  and 
facilities  caused  by  failure  to  comply  with  prescribed 
pr ocedur  es  . 

3.  preclude  loss  or  misuse  of  resources  caused  by  failure 
to  communicate  financial  information. 

4.  ensure  accounting  systems  provide  timely,  accurate, 
managerial  information  in  accordance  with  prescribed 
accounting  procedures. 

5.  ensure  cooperation  and  coordination  among  managerial, 
budgeting,  and  accounting  personnel. 

6.  ensure  the  financial  management  system  operates 
ef f ect i  vely . 

7.  ensure  an  adequate  system  of  fund  control. 

8.  eliminate  duplicative  accounting  efforts. 

9.  determine  financial  training  deficiencies  and  to 
recommend  proper  action. 

10.  determine  the  overall  health  of  the  finance  network. 
[Ref.  10] 

The  DA  policy  towards  the  administration  of  the  Quality 

Assurance  (QA)  Program  is  that  all  commanders  will  actively 

establish  and  support  a  quality  assurance  program  to 

accomplish  the  aforementioned  objectives.   To  provide  the 

essential  leadership  for  such  a  comprehensive  program,  the 

COA  was  given  responsibility  for  furnishing  general  staff 

supervision.   The  Assistant  Comptroller  of  the  Army  for 

Finance  and  Accounting  (ACOA  (F&A))  has  been  delegated  the 

responsibility  for  the  administration  of  the  program  and 

proponency  for  the  instructions  and  regulations.   Included  in 

the  responsibilities  are  the  providing  of  Finance  & 

Accounting  assistance  teams  for  review  of  FAOs.   The  review 
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of  FAOs  include  other  installation  activities  involved  in 
financial  management  to  enable  an  overall  evaluation  of  the 
financial  management  system.   The  ACOA  (FSA)  program  assigns 
specific  responsibilities  pertaining  to  quality  assurance  to 
the  major  command  commander,  major  subordinate  command 
commanders,  installation  and  activity  commanders,  and  FAO 
Officers. 

The  Director  for  Quality,  who  works  directly  for  the  ACOA 
(FSA),  is  responsible  to  him  for  the  administration  of  the  QA 
program.   The  mission  of  the  Director  for  Quality  is  to 
formulate  and  execute  plans  and  operating  policies  for  accom- 
plishing DA  Quality  Assurance  Program  Army-wide  objectives. 
Additionally  he  is  to  provide  independent  testing  and  valida- 
tion of  all  Joint  Uniform  Military  Pay  System  (JUMPS)  program 
and  system  changes,  to  include  pay  related  accounting  trans- 
actions and  output;  to  monitor  and  examine  the  effectiveness 
of  the  disbursing  office  network;  and  to  maintain  a  finance 
and  accounting  network  management  information  system.   The 
organization  of  the  Director  for  Quality  is  illustrated  at 
Fi  gur  e  1 1  -2. 

The  Director  for  Quality  provides  the  field  operations 
with  several  key  management  tools  to  assist  in  the  task  of 
assuring  quality  service  to  all  customers  of  a  finance  and 
accounting  office.   These  tools  include,  but  are  not  limited 
to: 


29 


DIRECTOR  FOR  QUALITY 


Office  of  Field 
Evaluation/ 
Analysis 


Examination 
Division 


Examination 
Branch  I 


Branch  II 


DIRECTOR 
FOR 
QUALITY 


Quality  Test  £ 
Val idation  Div. 


Test  Teams 
JUMPS-Act  Dty 


JUMPS-Res  Comp 


Admin,  and 
Operations 
Office 


Retired  Pay 


Pay  Acctg. 


Field  Quality 
Assistance  Div, 


Accounting 
Assistance  Br. 


Finance 
Assistance  Br. 


FIGURE  1 1-2 


30 


1.  the  ALL  POINTS  BULLETIN  -  a  monthly  financial 
management  newsletter  containing  a  myriad  of  financial 
management  information  from  budget  and  internal  review 
articles,  educational  and  job  opportunities,  to  the 
latest  changes  in  per  diem  rates  and  Comptroller 
General  decision  references. 

2.  the  publishing  of  a  monthly  model  standard  operating 
procedure  (SOP)  for  a  facet  of  finance  and  accounting 
operations. 

3.  the  publishing  of  monthly  performance  statistics 
provided  on  a  DA-wide  basis  for  pay  related  data, 
accounting  reporting  and  various  transaction  error  data 

4.  standardized  functional  checklists  for  DA,  MACOM  and 
local  quality  assurance  efforts  in  a  pr  of or  ma  internal 
audit  setting. 

5.  the  conduct  of  bi-annual  assistance  visits  by  DA 
Quality  Assurance  Assistance  Teams. 

6.  the  maintenance  and  publishing  of  statistical  data 
relating  to  semi-annual  trend  analysis,  including 
reports  to  MACOMs  and  functional  proponents. 

A  recent  addition  to  the  organization  of  the  Director 
for  Quality  is  the  establishment  of  the  Office  of  Field 
Evaluation  and  Analysis  (OFEA).   The  purpose  for  the 
establishment  of  OFEA  was  twofold.   First,  to  provide  summary 
management  information  to  the  ACOA  (F&A),  from  which  he  can 
make  decisions  which  will  improve  the  finance  and  accounting 
network,  and  second,  to  provide  feedback  to  the  field  for 
items  which  are  critical  to  effective  management.   To 
formulate  this  essential  field  management  information,  the 
Director  for  Quality  and  OFEA  have  determined  a  need  for 
continuous  and  common  data  from   all  finance  and  accounting 
operations  world-wide.   OFEA  monitors,  analyzes  and  distrib- 
utes JUMPS  status  reports,  which  depict  statistics  of  input 
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made  to  the  centralized  computer  facility  for  the  computation 
of  service  members'  monthly  pay  and  allowances.   The  OFEA 
functions  contribute  to  the  maintenance  and  analysis  of 
quantity  and  quality  performance  data  of  field  operations. 
To  fulfill  the  information  requirements,  OFEA  correlates  and 
analyzes  data  submitted  via  the  Finance  and  Accounting 
Monthly  Operations  Reports  (FINOPS)  with  additional  data 
available  within  the  other  directorates  at  USAFAC  (e.g. 
Financial  Network  Evaluation  System  (FINES)).   The  overall 
systematic  evaluation  and  analysis  of  these  data  provide  for 
the  identification  of  potential  problem  areas  and  facilitate 
the  management  decisions  to  be  made  to  alleviate  or  rectify 
the  problems  encountered  by  field  operations. 

The  FAOs  world-wide  are    responsible  for  the  assurance  of 
quality  service  provided  by  their  operations.   The  effective- 
ness of  each  command's  program  begins  at  the  commander's 
level.   The  regulatory  requirement  exists  for  each  commander 
to  establish  and  maintain  a  QA  Program.   However,  the  manner 
in  which  he  or  she  provides  leadership  will  determine  the 
degree  of  success  towards  the  attainment  of  DA  goals  or 
standards.   The  commander's  interest  in  the  monthly  opera- 
tions report  from  the  FAO  Officer  is  essential  in  motivating 
the  personnel  involved  at  the  worker  levels.   The  quality 
assurance  effort  in  the  FAO  is  formally  performed  by  an 
organizational  unit  called  the  Quality  Assurance  Branch  (QAB) 
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The  QAB  performs  comprehensive  operational  audits  of  all 
areas  within  the  FAO.   The  QAB  is  the  FAO  Officer's  indepen- 
dent internal  audit  staff,  and  must  perform  audits  in 
accordance  with  an  annual  written  plan.   The  plan  must  effec- 
tively insure  that  all  aspects  of  the  operation  are  reviewed 
and  a  written  report  rendered  of  each  review.   The  checklist 
developed  at  the  DA  level  provides  the  QAB  with  an  excellent 
basis  for  the  performance  of  a  review.   Additionally,  the 
published  guidance  from  the  Director  for  Quality,  on  topics 
such  as  the  quarterly  analysis  of  DA-wide  deficiencies  in 
financial  operations,  special  interest  items,  and  newly 
disclosed  areas  of  weaknesses  in  internal  control  should  be 
considered  in  local  QA  efforts/programs. 


0.   THE  AIR  FORCE  QUALITY  ASSURANCE  PROGRAM 

Recent  modifications  to  the  overall  DA  QA  Program 
resemble  some  of  the  earlier  United  States  Air  Force  (USAF) 
efforts  in  quality  assurance.   A  brief  overview  of  the  USAF 
Quality  Assurance  Program  is  hereby  provided. 

The  USAF  Quality  Assurance  Program  is  mandated  by  Air 
Force  Manual  177-10,  entitled  "Air  Force  Quality  Assurance 
Program  for  Accounting  and  Finance  Activities",  which 
prescribes  the  policy  and  procedures  related  to  the  Quality 
Assurance  program  for  USAF  Accounting  and  Finance  Offices 
(AFOs).   Guidance  is  provided  for  all  levels  of  command, 
however,  there  is  considerable  flexibility  for  Major  Commands 
(MAJCOM)  to  supplement  the  directed  program  with  companion 
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programs  to  maintain  USAF  desired  quality  levels.   The  USAF 
Accounting  and  Finance  Center  (AFAFC)  recently  announced 
major  changes  in  the  emphasis  of  its  accounting  and  finance 
network-wide  quality  assurance  efforts. 

The  USAF  Quality  Assurance  Program  in  effect  prior  to  1 
October  1980  had  two  primary  objectives:   error  prevention 
through  management  and  error  detection  [Ref.  12:   p.  3]. 
Error  prevention  stressed  the  management  processes  of 
planning,  organizing,  directing  and  controlling.   The  error 
detection  objective  of  the  Quality  Assurance  Program  relied 
heavily  on  a  program  entitled  CHECKPOINTS,  although  other  QA 
methods  were  used  as  well. 

AFAFC  designed  the  CHECKPOINTS  program  to  be  a  uniform 
method  of  evaluating  performance  in  accounting  and  finance 
operation  at  various  levels  of  command.   Initially, 
CHECKPOINTS  utilized  2  2  indicators  dealing  mostly  with 
timeliness  and  accuracy  of  "Reports  Control  Symbol"  (RCS) 
reports  submitted  monthly,  disbursement/collection  vouchers, 
and  military  pay  and  leave  source  documents.   The  indicators 
were  to  be  utilized  to  evaluate  MAJCOM  not  AFO  performance. 
However,  data  received  by  AFAFC  was  arrayed  and  analyzed  by 
both  MAJCOM  and  AFO  account  numbers.   Performance  was  to  be 
measured  against  standards,  which  were  based  on  the  most 
recent  three  year  performance  average.   The  rationale  for 
basing  the  standard  on  a  moving  average  was  the  assumption 
that  the  population  would  improve  its  performance  each  year, 
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causing  the  "normal  level"  to  raise,  against  which  subsequent 
year's  performance  should  be  judged.   The  relative  value  of 
the  CHECKPOINTS  evaluation  system  was  indicated  by  the  fact 
that  all  indicators  rated  by  CHECKPOINTS  improved,  such  that 
the  level  of  performance  accuracy  for  the  majority  of  rated 
areas  improved  to  better  than  the  98  percent  level  [Ref.   12: 
p.  4]. 

The  recent  changes  in  the  USAF  Quality  Assurance  Program 
precipitated  from  the  realization  that  too  much  reliance  was 
being  placed  upon  the  CHECKPOINTS  program  [Ref.  13:   p.  4]. 
The  Assistant  Comptroller  of  the  Air  Force  for  Accounting  and 
Finance  stated  in  a  November  1980  letter,  that  he  felt  that 
the  CHECKPOINTS  program  did  not  adequately  measure  the 
overall  quality  and  service  provided  by  an  accounting  and 
finance  office.   The  effectiveness  of  the  CHECKPOINTS  program 
was  not  in  question;  however,  the  desire  to  emphasize  other 
important  areas  such  as  customer  service  and  internal 
management  has  led  to  discontinuing  the  formal  rating  system 
[Ref.  13:   p.  1].   The  revised  Quality  Assurance  Program  for 
FY81  focusses  its  efforts  on  a  broader  base  of  office  and 
resource  management,  customer  service,  training,  results  of 
Inspector  General  inspections  and  audit  reports,  in  addition 
to  the  accuracy  and  timeliness  of  various  products  in  the 
financial  system. 

It  appears  that  the  USAF  Quality  Assurance  Program  is 
directing  itself  toward  more  fully  utilizing  the  motivational 
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talents  within  its  AFOs  and  MAJCOMs  to  insure  that  the  high 
standards  set  by  the  past  CHECKPOINTS  program  continue  to 
rise,  or  at  least  remain  at  those  high  levels.   However,  the 
USAF  will  continue  to  utilize  the  MAJCOMs  in  establishing 
their  own  evaluation  systems  to  measure  AFO  performance  in 
all  AFAFC  directed  quality  indicators. 

E.   SUMMARY 

This  chapter  has  provided  the  reader  with  the  background 
material  concerning  the  organizational  elements  of  the  DA 
financial  network  and  the  DA  and  !JSAF  QA  Programs,  to  gain  a 
perspective  necessary  to  understand  the  various  aspects  of 
the  DA  management  control  systems.   The  DA  QA  Program  was 
defined  earlier  as  a  plan  to  improve  the  quality,  accuracy 
and  timeliness  of  financial  services  world-wide. 

Chapter  III  will  provide  the  reader  with  a  description  of 
the  DA  financial  management  control  systems,  which  are  active 
parts  of  the  DA  QA  Program. 
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III.   DEPARTMENT  OF  THE  ARMY 
FINANCIAL  MANAGEMENT  CONTROL  SYSTEMS 

A.  INTRODUCTION 

The  purpose  of  this  chapter  is  to  provide  the  reader  with 
definitive  material  on  the  historical  development  and  current 
status  of  the  Department  of  the  Army  (DA)  financial 
management  control  system.   Addtionally,  this  chapter  will 
clarify,  through  the  use  of  narrative  descriptions,  the 
reports  and  data  indicators  used  in  the  DA  systems.   An 
overall  understanding  of  management  control  systems  and 
particularly  management  information  systems,  will  provide  the 
reader  with  information  necessary  to  understand  the  various 
aspects  of  the  DA  financial  management  control  system. 

B.  MANAGEMENT  INFORMATION 

A  management  information  system  can  be  thought  of  as  any 
systematic  process  for  providing  reports,  data  or  other 
output  [Ref.  14:  p.  172].   A  spy  is  a  type  of  information 
system,  as  is  a  group  of  clerks  who  process  checks  and 
deposits  in  a  bank.   Massie  states  that  an  information  system 
has  three  essential  components:   inputs,  processes  and 
outputs.   The  creation  and  storage  of  inputs,  performance  of 
processes,  and  creation  and  storage  of  outputs  are  the 
functions  of  an  information  system.   A  management  information 
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system  is  defined  by  J.  L.  Massie  as  "an  all-inclusive  sys-tem 
for  providing  management  with  information  for  effective 
decision  making"  [Ref.  14:  p.  253]. 

Management  information  can  be  conveniently  categorized 
into  the  traditional  planning  and  control  processes  [Ref.  14: 
p.  173].   Planning  is  deciding  what  should  be  done  and  how  it 
should  be  done,  and  control  is  assuring  that  the  desired 
results  are  obtained.   In  organizations  two  types  of  planning 
and  control  processes  can  be  identified  in  relation  to 
management  information.   They  are  strategic  planning  and 
management  control.   As  defined  by  Robert  N.  Anthony,  "strat- 
egic planning  is  the  process  of  deciding  on  the  goals  of  an 
organization  and  on  the  broad  strategies  that  are  to  be  used 
in  attaining  these  goals"  [Ref.  15:   p.  7].   Strategic 
planning  information  depends  heavily  upon  information 
external  to  a  specific  organization. 

Management  control  combines  this  information  with 
internal  data  in  order  to  make  estimates  of  expected  results. 
The  specifics  of  this  information  are  usually  unique  to 
individual  strategic  problems.   Management  control 
information  ties  together  various  subacti vi ties  in  a  coherent 
way  so  that  managers  can  gauge  resource  utilization  and 
compare  expected  results  with  the  actual  results.   Inputs  to 
management  control  information  come  from  various  groups 
within  the  organization,  often  cutting  across  established 
functional  boundaries  [Ref.  15]. 
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The  DA,  as  any  other  large  organization,  has  a  need  for 
management  control  information.   The  Assistant  Comptroller  of 
the  Army  for  Finance  and  Accounting  (ACOA  (F&A))  is  charged 
with  the  responsibility  for  the  efficient  and  effective 
operation  of  the  world-wide  financial  network.   In  order  to 
successfully  accomplish  its  given  mission,  the  Office  of  the 
ACOA  (F&A)  must  have  available  factual  and  timely  information 
from  field  offices  submitted  through  command  channels. 


C.   FINANCE  INFORMATION  NETWORK  EVALUATION  SYSTEMS  (FINES) 
1 .   Pur  pose 

FINES  is  a  management  information  system  within  the 
United  States  Army  Finance  and  Accounting  Center  (USAFAC). 
It  is  designed  to  capture  quality  and  quantity  performance 
data  on  field  finance  operations  for  the  ACOA  (F&A).   FINES 
assimilates   the  data  available  through  the  Finance  and 
Accounting  Monthly  Operations  Report  (FINOPS)  with  other  data 
available  within  USAFAC.   This  information  is  accessible  to 
all  directorates  within  USAFAC.   The  information  obtained 
through  the  FINES  system  provides  for  identification  of 
potential  field  problems  and  subsequent  scheduling  of  field 
quality  assistance  visits,  based  on  the  problems  identified. 
The  system  gives  USAFAC  the  capability  for  quantity  and 
quality  feedback  to  the  field  finance  offices.   Finally, 
FINES  is  designed  to  provide  an    overall  "Health  of  the 
Finance  Network"  profile  by  individual  field  FAO '  s  Disbursing 
Station  Symbol  Number  (DSSN)  [Ref.  16:   p.  1]. 
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2.   Backgr  ound 

During  the  1974-75  time  period,  the  Commander  USAFAC 
requested  that  a  quality  measurement  program  be  developed 
which  would  be  able  to  assess  the  health  of  the  DA  financial 
information  network.  The  USAFAC  staff  proposed  a  list  of 
reporting  items  for  internal  use  within  USAFAC  [Ref.  16: 
p.l].   The  proposed  criteria  were  disseminated  to  the  USAFAC 
directorates  for  coordination  and  comment.   No  further  action 
was  taken  on  the  project  until  early  1976  when  the  project 
became  a  Comptroller  of  the  Army  ( COA  )-di r ected  financial 
management  improvement  project  (LR8501).   The  emphasis  on  the 
project  was  directed  toward  developing  an  information  system 
which  would  have  allowed  USAFAC  to  determine  which  stations 
had  the  greatest  need  for  field  quality  assistance.   The 
project  made  little  headway  in  developing  measurement  crite- 
ria due  to  a  lack  of  both  resources  and  emphasis  within 
USAFAC's  Office  of  the  Director  for  Quality,  the  project's 
sponsor  [Ref.  17].   In  1977  the  project  was  reinitiated  under 
the  auspices  of  the  Comptroller,  USAFAC.   The  project  took  a 
new  direction,  that  of  creating  an  automated  information  sys- 
tem for  the  command.   However,  for  many  of  the  same  reasons 
that  plagued  the  project  in  the  past  it  again  became  inactive 
[Ref.  16:  p.  2].   In  1979  the  responsibility  for  the  project 
was  returned  to  the  Director  for  Quality.   The  goal  of  the 
project  since  then  has  been  to  develop  a  mechanism  for 
providing  the  capability  to  compile  and  analyze  quality  and 
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quantity  data  available  within  USAFAC  and  from  the  field  FAOs 
for  the  purpose  of  more  effective  management  of  the  finance 
and  accounting  network  [Ref.  18]. 
3.   Reporting  Requirements 

FINES  provides  detailed  information  regarding  the 
activities  of  individual  field  FAOs  on  a  monthly  basis. 
Information  gathered  through  FINES  includes  summaries  of 
audit  results,  Joint  Uniform  Military  Pay  System  (JUMPS)-Army 
reporting  transactions,  accounting  operations  and  centralized 
pay  oper  at i  ons  data . 

a  .   Audi  t  Resul t s 

The  Office  of  the  COA  provides  summary  data  on 
Army  Audit  Agency,  Inspector  General,  and  General  Accounting 
Office  audits  conducted  during  the  month.   The  data 
identifies  the  number  of  significant  findings  and  the 
corresponding  number  of  findings  which  were  caused  by 
processing  failures.   This  data  is  segregated  into  the 
categories;  military  pay,  reserve  pay,    travel  entitlements, 
commercial  accounts,  civilian  pay  and  accounting. 

b.   JUMPS-Army  Reporting  Transactions 

Statistical  information  pertaining  to  both  active 
and  reserve  forces'  monthly  strength  balances  is  collected. 
Additional  information  summarizes  the  number  of  pay 
transactions  processed,  rejected,  and  submitted  late  during 
the  month . 
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c.  Accounting  Operations 

This  section  identifies  the  number  of  accounts 
which  are  out  of  balance  and  the  total  number  of  transaction 
errors  committed  for  each  account  during  the  month. 
Additional  information  pertaining  to  uncleared  interfund 
transfers  is  summarized. 

d.  Centralized  Pay  Operations 

Summaries  are  presented  for  the  total  number  of 
stop  pay  requests,  pay  option  to  financial  institution 
requests,  bonus  vouchers,  and  input  messages.   The 
information  is  identified  by  the  categories  of  military  pay, 
travel,  allotments  and  other  transactions. 
4.   Future  Objective 

A  future  objective  of  USA FA C  is  to  develop  a  data 
base  management  system  that  is  accessible  to  all  USAFAC 
directorates  with  the  capability  of  including  FINES  report 
data,  F I  NOP  S  report  data  and  the  results  of  field  quality 
assistance  visits.   Additionally,  the  system  strives  to 
develop  a  network  profile  of  the  field  FAOs  based  on  the 
quality  of  service  provided.   It  is  a  goal  of  the  system  to 
provide  enough  information  to  allow  the  Director  for  Quality 
to  tailor  a  Quality  Assurance  Assistance  Program  based  on 
problems  and  needs  identified  by  this  information  system 
[Ref.  16:   p.  2]. 
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D.   FINANCE  AND  ACCOUNTING  MONTHLY  OPERATIONS  REPORT  (FINOPS) 

1 .  Background  and  Purpose 

FINOPS  is  a  management  information  reporting  system 
which  will  provide  the  DA  finance  network  with  essential 
staffing,  productivity,  workload,  training  and  performance 
data. 

The  ACOA  (F&A)  is  charged  with  responsibilities  which 
include  monitoring  the  effectiveness  of  field  FAOs, 
exercising  overall  technical  supervision  of  the  DA-wide 
finance  and  accounting  network,  providing  adequate  and  timely 
finance  and  accounting  services  to  the  DA,  and  monitoring  the 
training  of  both  civilian  and  military  members  within  the  DA 
school  system.   To  assist  the  ACOA(FSA)  in  fulfilling  the 
responsibilities,  a  system  which  enhances  the  flow  of 
information  between  field  finance  offices,  installation 
managers,  Major  Commands  and  USAFAC  must  exist.   The  Finance 
and  Accounting  Monthly  Operations  Report  (FINOP),  RCS-CSCOA- 
67,  was  designed  as  a  means  of  providing  this  needed 
i  nf ormat i  on. 

2.  History 

Starting  in  March  1948  with  change  1  to  Technical 
Manual  14-500  entitled  "Finance  and  Accounting  Operations", 
all  field  finance  activities  were  required  to  submit  a 
"Monthly  Report  of  Operations",  RCS  FIN-20,  to  the  Chief  of 
Finance  (now  known  as  the  COA).   The  use  of  this  report  was 
discontinued  in  November  of  1950  by  the  publication  of 
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Special  Regulation  35-3710-1  entitled  "Finance  and  Fiscal: 
Monthly  Report  of  Operations".   No  operations  reports  were 
used  during  the  ensuing  five-year  period  until  February  1955 
with  the  publication  of  Army  Regulation  (AR)  35-3710, 
entitled  "Finance  and  Fiscal:   Finance  and  Accounting 
Operations".   This  regulation  required  a  monthly  report  of 
operations,  "The  Finance  and  Accounting  Operations  Report", 
RCS  FIN-113.   The  report  requirement  remained  in  effect  until 
May  1961  when  the  report  was  ret i tied  "Finance  Operations 
Summary",  RCS  FIN-143,  and  became  a  quarterly  report. 

In  1971  the  DA  finance  and  accounting  community 
underwent  a  change  in  its  organizational  structure.   The 
functions  of  the  office  of  Chief  of  Finance  were  transferred 
to  the  Office  of  the  COA.   Concurrent  with  this  transfer  of 
functions,  the  requirements  for  financial  operations  reports 
were  rescinded  [Ref.  19].   Up  to  this  point,  each  of  the 
operations  reports  was  designed  to  provide  the  Chief  of 
Finance  with  factual  and  timely  operational  data  pertaining 
to  the  effectiveness  of  field  finance  activities,  and  each 
included  operating  results,  staffing  data,  and  narrative 
r  emar  ks . 

Subsequent  to  the  establishment  of  the  Office  of  the 
COA  in  1971  and  until  the  F I  NO  P  S  reporting  requirements  in 
1980,  no  formal  requirement  existed  for  reporting  the  results 
of  field  operations  through  the  chain  of  command  to  the  DA 
staff  level,  and,  consequently,  no  way  to  routinely  monitor 
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operations  in  the  field  existed.   As  a  result,  managers  at 
the  major  commands  (MACOMs)  and  DA  were  forced  to  make 
subjective  assessments  regarding  the  services  being  performed 
by  field  offices. 

3.   Reporting  Requirements 

The  FINOPS  report  provides  detailed  information  on 
workload  data,  staffing,  manhours,  training  and  a  remarks 
section. 

a.   Workload  Data 

Workload  data  in  the  form  of  selected  work  units 
for  each  functional  area  in  the  office  and  identifying  the 
beginning  and  ending  balances  of  wor k-i n- pr ocess  for  critical 
work  units  is  reported  in  section  A  . 

b  .   St af f i  ng 

Authorized  and  assigned  personnel  strength,  by 
personnel  category  and  functional  element,  is  reported  in 
section  B.   This  data  is  reported  annually,  with  only  changes 
reported  monthly,  thereby  reducing  workload  in  the  field,  but 
significantly  increasing  the  difficulty  of  manual  analysis  at 
USAFAC. 

c  .   Manhour  s 

Total  standard  manhours  available  and  productive 
manhours  worked  by  functional  element  during  the  reporting 
period  are  reported  in  section  C. 

d.   Remarks 

Problems  requiring  command  attention,  normally 
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outside  the  scope  of  the  finance  officer,  are  reported  in 
Section  D,  the  remarks  section.   New  procedures,  methods  or 
equipment  which  would  be  of  benefit  to  others  in  the  network 
are  also  reported  in  the  remarks  section.   This  section 
provides  a  forum  for  dialogue  between  the  field  finance 
offices  and  the  major  commands, 
e .   Training 

The  training  profile  of  the  finance  office  plus 
the  FAO  Officers'  narrative  evaluation  of  effectiveness  of 
the  traning  received,  in  terms  of  job  performance,  is 
reported  in  section  E  on  a  quarterly  basis.   The  quality  and 
quantity  of  military  training  is  based  on  attendance  at 
military  schools. 

(1)  Enlisted  Training  Status.   The  report 
indicates  the  percentage  of  enlisted  personnel  assigned  to 
finance  offices  who  are  school-trained  in  their  designated 
Military  Occupational  Specialties.   At  the  DA  level,  the 
report  will  indicate  how  the  MACOMs  stand  in  relation  to  the 
DA-wide  average  for  field  finance  offices  in  school-trained 
enlisted  personnel. 

(2)  Officer  Training  Status.   The  FINOPS 
report  contains  information  on  the  percentage  of  all  officers 
in  field  finance  operations  who  have  attended  the  Finance 
Officers  Advanced  Course.   At  the  DA  level,  the  report  will 
provide  data  on  the  percentage  of  officers  who  have  attended 
basic,   advanced  and  staff  schools.   This  will  allow  for  a 
comparison  of  the  MACOMs  to  the  DA-wide  average. 
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4.   Uses  of  FINOPS 

The  FINOPS  report  amasses  data  pertaining  to  the  DA 
finance  and  accounting  network.   The  report  has  utility  at 
the  three  major  levels  of  control  in  the  DA's  finance  and 
accounting  system.   The  first  and  lowest  level  of  data 
collection  in  the  network  is  the  installation.   The  second 
level  exists  at  the  MACOMs,  and  the  final  level  of  the  DA 
finance  and  accounting  system  is  the  DA  staff  level. 

a.  Installation 

At  the  installation,  the  FAO  Officer  now  has 
information  at  his  or  her  disposal  which  can  be  of  assistance 
in  identifying  existing  and  potential  problems.   Backlogs  and 
unfavorable  trends  can  be  identified  and  analyzed;  overtime 
utilization  monitored  and  justified;  staffing  defended  in 
terms  of  work  accomplished;  and  productivity  measured.   The 
report  assists  the  FAO  Officer  in  identifying  and  assessing 
the  impact  on  mission  accomplishment  of  time  lost  due  to 
administrative  absences,  training  and  leave.   The  report 
enables  the  officer  to  highlight  both  his  or  her  training 
needs  and  training  programs  to  his  or  her  commander. 
Finally,  the  narrative  section  gives  the  FAO  Officer  a 
vehicle  to  surface  problems  which  require  command  assistance 
in  resolution. 

b.  MACOM 

At  the  MACOM,  analysis  of  the  reports  provides  a 
profile  of  the  finance  network  within  the  command,  and  serves 
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as  an  indispensable  tool  in  the  development  of  a  strong 
quality  assurance  assistance  program.   Finance  organization 
structures  and  staffing  can  be  evaluated  in  terms  of 
capabilities  to  accomplish  assigned  missions.   A  knowledge  of 
personnel  staffing  and  vacancies  can  enable  the  command  to 
assist  installations  in  recruiting  civilian  personnel  and 
requisitioning  military  personnel  to  fill  vacancies. 
Finally,  the  composite  training  status  aides  the  training 
manager  in  requesting  and  obtaining  quotas  to  selected 
courses  and  requesting  the  assistance  of  mobile  training 
teams  from  the  proponent  activity  where  appropriate. 

c.   DA 

The  analysis  of  the  information  provided  by  the 
FINOPS  report  allows  the  ACOA  (F&A)  to  better  communicate  the 
needs  of  the  DA  finance  and  accounting  network  to  the  DA 
staff.   Typical  organization  structures  can  be  evaluated  in 
terms  of  both  workload  and  mission  capability,  with 
appropriate  modifications  initiated  and  defended.   New 
procedures  can  be  analyzed.  In  addition,  the  ACOA  (F&A)  can 
effectively  recommend  assignments  of  qualified  personnel  to 
field  stations  with  real  and  documented  needs. 
5.   Implementation  of  FINOPS 

The  implementation  of  FINOPS  is  divided  into  three 
separate  phases.   Phase  I  was  a  manual  system  submitted 
through  command  channels.   Phase  II  consists  of  interfacing 
the  manual  FINOPS  system  to  the  Finance  Network  Evaluation 
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Systems  (FINES)  within  USAFAC.   Phase  III  will  be  the  final 
phase  where  the  system  becomes  fully  automated  and  integrated 
into  the  JUMPS-Standar d  Finance  System  (STANFINS)  (the 
standard  DA  accounting  system)  system  of  accounting  and 
reporting  [ R e f .  20]. 

a.  Phase  I 

Phase  I  began  at  the  beginning  of  fiscal  year 
1981,  i.e.,  October  1980.   The  report  was  manually  prepared 
in  the  field,  submitted  through  channels  by  mail,  and 
manually  analyzed  at  USAFAC. 

b.  Phase  1 1 

In  early  1981,  the  manual  data  base  establshed  in 
Phase  I  began  the  initial  stages  of  automation  and  interface 
with  FINES.   This  interface  facilitates  the  construction  of  a 
comprehensive  profile  for  each  DSSN/Fiscal  Station  Number 
(FSN)  in  the  DA.   From  this  profile  will  evolve  the  capabil- 
ity for  fielding  a  more  effective  and  comprehensive  quality 
assurance  program.   To  formalize  the  FINOPS  report,  the 
reporting  requirement  is  being  incorporated  into  AR  11-37. 

c.  Phase  I II 

In  the  final  phase,  the  field  input  will  be 
integrated  into  the  productivity  modules  of  the  JUMPS-Army 
coding  system,  (JUMPS  redesign)  and  the  Standard  Army 
Accounting  System    (STANFINS  redesign).   This  will  eliminate 
manual  preparation  of  the  report  in  the  field,  and  will 
result  in  the  data  feeding  directly  into  the  USAFAC  data  base 
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via  Automatic  Digital  Network  (AUTOOIN),  an  electronic  data 
transmission  and  processing  system. 
6 .   S  ummary 

FINOPS  will  provide  the  ACOA  (F&A)  with  the 
capability  to  monitor  the  DA ' s  finance  and  accounting 
networks.   The  authors  contend  that  this  capability  is 
essential  if  the  ACOA  (F&A)  is  to  effectively  manage  the 
finance  network.   The   report  insures  a  continual  flow  of 
information  up  the  chain  of  command.   The  section  pertaining 
to  training  will  allow  USAFAC  to  be  more  effective  in 
interfacing  with  TRADOC  and  the  Institute  of  Personnel  and 
Resource  Management  concerning  the  adequacy  of  current 
courses  of  instruction  and  in  identifying  future  training 
needs.   Finally,  the  remarks  section  provides  an  open  forum 
to  identify  problems,  highlight  innovative  ideas,  and  promote 
a  general  information  exchange  within  the  DA ' s  finance  and 
accounting  network. 

E.   DEVELOPMENT  OF  CRITICAL  DATA  INDICATORS 

The  ACOA  (F&A),  the  DA  proponent  for  financial  management 
has  defined  "critical  data  indicator"  as  "the  essential 
quality  or  quantity  element(s)  in  a  performance  evaluation  of 
a  functional  area."  [Ref.  20]. 

The  establishment  of  critical  data  indicators  for 
specific  functional  areas,  and  the  reporting  and  analysis  of 
such  data  will  provide  the  necessary  information  to  ascertain 
the  overall  health  of  the  finance  network.   Reporting  quality 
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and  quantity  data  by  field  stations,  will  provide  a  continu- 
ous and  consistent  stream  of  pertinent  information  to  be 
utilized  at  various  levels  of  management  in  determining  and 
evaluating  the  field  stations'  ability  to  accomplish  assigned 
missions.   The  determination  of  critical  data  indicators  is 
made  by  the  ACOA  (FSA)  and  his  staff.   The  list  of  indicators 
may  be  changed  or  expanded  by  the  ACOA  (F&A)  as  time 
progresses.   How  the  data  will  be  utilized  depends  on  the 
level  of  management  analyzing  the  reported  data. 

The  compilation  and  evaluation  of  these  critical  data 
indicators  by  various  levels  of  management  will  facilitate 
the  development  of  operational  profiles  within  that  level  of 
management.   For  example,  the  evaluation  by  the  TRADOC  of  the 
critical  data  indicators  for  TRADOC  installations  will  pro- 
vide a  TRADOC  profile.   Headquarters,  TRADOC  will  be  able  to 
detect  problem  areas  and  workload  inefficiencies  as  well  as 
superior  performances  within  the  major  command.   The  evalua- 
tion at  the  DA  level  facilitates  the  development  of  a  profile 
for  the  entire  DA.   Brief  desciptions  of  the  current  critical 
data  indicators  by  functional  areas  are    in  Table  1 1 1 - 1 . 

F.   CURRENT  USES  OF  DATA 
1.   Basic  Uses 

Interviews  between  the  authors  and  DA  financial 
management  personnel  indicate  that  the  performance  data 
collected  in  the  FINES  and  FINOPS  reporting  systems  are 
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TABLE  III-l 
CRITICAL  DATA  INDICATORS 
Functional  Category:  Disbursing 

Indicator  Purpose 


Number  of  Losses  of  Funds 
Number  of  Fraud  cases 


Number  of  Droppages 
Number  of  Payments 


to  identify  potential  problems  in  cash 
operations,  requiring  investigation 

to  identify  fraud  trends  against 
Army-wide  statistics 

to  establish  trends  on  the  number  of 
quarterly  droppages  in  relation  to  the 
total  number  of  cash  payments 


Functional  Category:  Quality  Assurance 
Indicator 


Reviews  completed 


Cumulative  reviews  started 


Manhours  assigned 

Total  manhours  assigned  to 
the  FAO 


Purpose 


to  assess  the  percentage  of  reviews 
initiated  which  are  completed,  shows 
activity  of  local  QA  programs 

to  determine  the  relative  level  of 
personnel  resources  committed  to  the 
local  QA  program 


Functional  Category:  Accounting 

Indicator 

Errors  on  302  Report 

Numbers  of  Records  passed 

Number  of  late  302  Reports 

Number  of  late  304  Reports 

Number  of  late  1061  Reports 

Number  of  Uncleared  Transac- 
tions by  Others  (TBO)  over 

60  days  old 

Total  Uncleared  TBOs 


Purpose 

to  determine  error  rates  and  accuracy 
of  302  Report  submissions 

timeliness  of  critical  report 
submissions 


to  isolate  the  70%  uncleared  TBO's  in 
excess  of  60  days,  to  reflect 
timeliness  of  processing  TBOs 
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TABLE  III-l  (cont.) 


Functional  Category:  Travel 

Indicator 

Actual  output 
Standard  output 

Ending  balance  of  number  of 

settlement  vouchers 

total  vouchers  processed  - 
number  of  workdays 

Summary  level  standard  manhours 
Assigned  manhours 


Purpose 

to  assess  the  volume  efficiency  of 
the  labor  force 

to  determine  and  analyze  the  number 
days  backlog  at  month  end 


to  assess  the  staffing  level  in  re- 
lation to  the  level  required  by  the 
summary  level  performance  standards 


Functional  Category:  Commercial  Accounts 


Indicator 

Summary  level  standard  manhours 
Assigned  manhours 


Ending  balance  of  number  of 
Receiving  Reports  &  Invoices 
total  number  processed  - 
number  of  workdays 

Earned  discount  dollars 

total  discount  dollars  available 


Purpose 


to  assess  the  staffing  level  in  re- 
lation to  the  level  required  by  the 
summary  level  performance  standards 

to  determine  and  analyze  the  number 
of  days  backlog  at  month  end 


to  determine  the  operational  effi- 
ciency of  the  activity  in  earning 
available  discount  dollars 


Functional  Category:  Central  Accounting 
Indicator 


Transactions  processed 

Manhours  assigned/available 

Ending  balance  of  Daily 

Activity  Reports 

Number  of  NAFIs  serviced 

Ending  balance  of  number  of 
Invoices  &  Receiving  Reports 
total  number  of  Invoices  S 

Receiving  Reports  - 

number  of  workdays 


Purpose 


to  determine  trends  relative  to 
staffing  levels  and  volume  of  work 

to  determine  the  number  of  days  of 
unprocessed  activity  reports  on  hand 


to  determine  the  number  of  days  work 
on  hand 
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TABLE  III-l  (cont.) 
Functional  Category:  Military  Pay 

Indicator  Purpose 


JUMPS-Army  Reject  Rate 


JUMPS-Army  Late  Pay  Change  Rate 


No.  of  transaction  cards 
submitted  during  the  last 
3  updates  of  a  processing  month 
total  transaction  cards 
submitted  for  the  month 

Number  of  people  paid  correctly 


Number  of  accounts  per  clerk 


to  analyze  the  level  of  rejected  JUMPS- 
Army  input  transactions  and  to 
identify  potential  problems/  trends 

to  establish  and  analyze  trends  in 
timeliness  of  pay  service 

to  determine  if  operations  are  using 
cyclical  or  batch  processing  by  delay- 
ing input  until  the  final  20-25%  of  the 
update  cycles 


to  determine  the  effectiveness  of  the 
FAO  in  providing  proper  pay  service 

to  determine  the  relative  staffing 
level  to  the  number  of  soldiers 
serviced 


Functional  Category:  Civilian  Pay 

Indicator 

No.  of  unacceptable  retirement 

packets  received 

total  number  of  retirement 
packets  received 

No.  of  inquiries 

Average  No.  of  accounts 


No.  of  retirement  packets 

received 

No.  of  retirement  packets 
received  more  than  30  days  late 

[Ref.  16:   pp.  24-27] 


Purpose 

to  determine  the  quality  of  civil 
service  retirement  packet  submissions 


to  assess  the  quality  of  pay  service 
provided,  based  on  the  number  of 
inquiries 

to  determine  the  timeliness  of  retire- 
ment packet  submission,  directly  re- 
flecting timeliness  of  receipt  of 
retirement  benefits 
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useful  throughout  the  DA  finance  and  accounting  structure. 
Primarily,  the  data  is  used  to  make  comparisons  among  MACOMs 
and  among  individual  DSSNs  within  the  same  MACOM.   The 
statistical  comparisons  of  the  data  are  also  useful  as  a 
means  to  assist  the  Director  for  Quality,  USAFAC,  in 
determining  which  FAQs  are  in  need  of  an  assistance  visit. 
The  data  can  be  used  to  establish  performance  standards  for 
individual  MACOMs  or  for  the  DA  as  a  whole.   These  standards 
may  be  based  on  past  performance,  making  it  possible  to 
compare  current  performance  to  the  standards  and  determine 
whether  there  is  any  trend  in  the  data  and  if  so,  whether  the 
trend  is  toward  increased  or  decreased  performance. 
2.   Measurement  of  Efficiency 

The  FINES  and  FINOPS  reporting  systems  furnish 
information  which  can  be  used  for  determining  efficiency. 
Efficiency  is  the  ratio  of  outputs  to  inputs,  or  the  amount 
of  output  per  unit  of  input  [ R e f .  15:   p.  173].   For  example, 
DSSN  number  one  is  more  efficient  than  DSSN  number  two  if  it 
either  uses  fewer  resources  than  DSSN  number  two  but  has  the 
same  output,  or  if  it  uses  the  same  amount  of  resources  as 
DSSN  number  two  and  has  a  greater  output.   In  practice,  the 
second  type  of  efficiency  comparison  requires  a  quantitative 
measurement  of  output,  which  turns  out  to  be  a  more  difficult 
type  of  measurement  in  many  situations. 

Effectiveness  is  the  relationship  between  a  work 
center's  output  and  its  stated  objectives  [Ref.  15:   p.  173]. 
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The  more  these  outputs  contribute  to  the  accomplishment  of 
the  objectives,  the  more  effective  the  unit  is.   Both 
objectives  and  outputs  are  often  difficult  to  quantify, 
thereby  making  meaningful  quantitative  measures  of  effective- 
ness difficult  to  develop.   No  attempt  is  made  to  assess 
effectiveness  through  FINES  or  FINOPS,  since  no  effectiveness 
objectives  or  goals  are  currently  stated  or  in  use. 
The  efficient  office  may  well  be  ineffective  and  vice  versa. 

The  authors  believe  that  without  a  quantifiable 
statement  of  objectives,  the  effectiveness  of  an  individual 
FAO  cannot  readily  be  judged.   It  is  the  authors'  opinion 
that  the  assessment  of  the  efficiency  of  individual  FAOs  as 
well  as  the  efficiency  of  the  MACOMs  in  financial  management 
areas  of  concern  can  be  facilitated  by  the  analysis  of  the 
information  collected  through  the  FINES  and  FINOPS  reporting 
systems . 

The  efficiency  of  an    operation  can  also  be  assessed 
by  its  conformance  to  predetermined  performance  standards. 
Two  areas  reported  under  FINOPS  lend  themselves  well  to  the 
establishment  of  predetermined  standards  similar  to  methods 
utilized  in  the  industrial  engineering  community.   These 
areas  are  workload  data  and  staffing  requirements.   The  other 
areas  reported,  including  acceptance  rate  for  JUMPS-Army 
transactions,  late  pay  change  rate  and  the  percent  of 
transactions  input  during  the  last  three  updates  of  a  JUMPS 
processing  month,  can  be  better  compared  through  the  use  of 
historical  standards  or  moving  averages. 
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The  development  of  either  type  of  standard 
accomplishes  two  things.   First,  it  sets  an  acceptable  level 
of  performance  for  measuring  efficiency.   Second,  setting 
standards  precludes  the  arbitrary  measurement  of  efficiency 
in  terms  of  the  performance  of  another  FAO.   The  authors 
contend  that  establishing  standards  is  not  easy  nor  will  it 
be  a  panacea  for  solving  efficient  measurement  problems  for 
FAOs.   Careful  consideration  must  be  given  as  to  the  type  of 
standard  established  for  each  ar e a  within  the  FINES  and 
FINOPS  systems. 

3.   Utility  to  Levels  of  Decision  Makers 

Within  an  organization,  the  information  needs  of 
decision  makers  change  relative  to  their  position  in  the 
organizational  hierarchy.   Lower  echelons  within  the 
organizational  hierarchy  require  information  on  a  more 
detailed  and  timely  basis  than  do  the  echelons  toward  the  top 
FINOPS  data  has  utility  at  each  level  of  control  within  the 
DA ' s  finance  and  accounting  system. 

At  the  USAFAC  level,  the  reported  data  plays  an 
important  role  in  assessing  current  performance  of  MACOMs  in 
relationship  to  past  performance.   Additionally,  adverse 
trends  are  readily  identified  and  the  individual  FAO 
performing  at  a  substandard  level  can  be  targeted  for  a 
corrective  assistance  visit.   This  is  the  level  of  decision 
making  which  will  be  addressed  in  the  data  analysis  portion 
of  this  thesis. 
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The  MACOMs  and  installations  will  find  much  of  the 
data  reported  through  FINOPS  useful  in  trend  analysis  and 
staffing  requirements.   This  thesis  does  not  specifically 
address  either  of  these  levels  of  decision  making. 

G.   SUMMARY 

This  chapter  has  provided  the  reader  with  material 
concerning  the  historical  development  and  current  status  of 
DA  financial  management  control  systems.   This  chapter 
described  FINES  and  FINOPS,  the  two  primary  management 
information  systems  used  by  USAFAC  in  monitoring  the 
performance  of  field  FAOs.   FINES  is  a  management  information 
system  internal  to  USAFAC,  which  was  designed  to  report 
quality  and  quantity  performance  data.   FINOPS  is  a  reporting 
system  which  provides  USAFAC  with  detailed  monthly 
information  as  to  workload,  staffing,  manhours,  and  training 
of  field  FAOs.   Key  elements  of  the  DA  financial  management 
control  systems  are  the  "critical  data  indicators"  developed 
for  use  by  FINES  and  FINOPS. 

Chapter  IV  will  provide  the  reader  with  author  developed 
methods  for  identifying  substandard  FAO  performance;  assess- 
ing the  effect  of  QA  assistance  visits  on  FAO  performance; 
and  establishing  a  network  profile  of  the  current  health  of 
the  DA  financial  management  system  utilizing  some  of  the 
critical  data  indicators  descibed  in  Chapter  III  and  data 
submitted  through  FINES  and  FINOPS. 
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IV.   ANALYSES  OF  DATA 

A.   INTRODUCTION 

This  chapter  provides  the  reader  with  the  analyses  of 
data  from  which  methodologies  will  be  derived  for  identifying 
substandard  performances  by  Department  of  the  Army  (DA) 
Finance  and  Accounting  Offices  (FAOs)  and  for  enabling  the 
Director  for  Quality,  United  States  Army  Finance  and 
Accounting  Center  (USAFAC),  to  assess  the  current  health  of 
the  overall  DA  financial  network.   This  chapter  will  also 
describe  a  test  for  assessing  the  effectiveness  of  the  DA 
Quality  Assurance  (QA)  assistance  visits.   The  analyses  were 
based  on  a  sample  of  FAO '  s  Joint  Uniform  Military  Pay  System 
(JUMPS)-Army  transaction  performance  data.   The  sample  data 
will  be  examined  through  the  use  of  various  statistical  tests 
to  determine  the  appropriate  analytical  model  to  be  used  for 
developing  the  methodologies.   Additionally,  this  chapter 
provides  the  necessary  background  to  allow  the  Directorate 
for  Quality,  Office  of  Field  Evaluation/  Analysis  (OFEA)  to 
utilize  the  methodologies  developed  in  this  chapter  to  assess 
performance  for  other  critical  data  indicators  not  discussed 
in  detail  in  this  thesis. 

The  current  aggregation  of  data  at  USAFAC  is  suitable  for 
numerous  methods  of  statistical  and  graphical  data,  analysis 
for  measuring  performance.   However,  USAFAC  does  not 
currently  analyze  FAO  performance  in  terms  of  DA/MACOM 
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performance  standards,  or  evaluate  the  overall  statistical 
performance  of  a  FAO  in  terms  of  the  critical  data  indicators 
described  in  Chapter  III.   Current  methods  for  assessing  the 
performance  of  a  FAO  consist  of  a  bi-annual  assistance  visit 
provided  by  the  DA  0  A  Assistance  Teams,  and  a  periodic  exami- 
nation of  supporting  documentation  and  payment  documents. 
The  assistance  visit,  previously  descibed  in  Chapter  II, 
provides  a  thorough  review  of  administrative  and  accounting 
controls  within  the  FAO.   The  authors  were  requested  by  the 
OFEA  to  develop  methodologies  for  assessing  the  overall 
performance  of  the  DA  financial  network  through  the  objectiv- 
es set  forth  in  Chapter  I. 

A  word  of  caution  must  be  provided  at  this  time  in  inter- 
preting statistical  validity  and  significance  and  relating  it 
to  practicality  in  real  world  application.   The  authors  will 
state,  throughout  the  remaining  chapters  of  this  thesis  that 
statistically  significant  differences  exist  in  several  of  the 
alternatives  and  tests.   However,  these  differences  may  not 
be  of  any  practical  use  or  real  world  application.   Converse- 
ly, real  differences  may  be  present  but  not  brought  forth  in 
statistical  analyses.   The  use  of  the  statistical  facts 
disclosed  in  this  thesis  remains  judgmental. 

Conclusions  concerning  the  relevance  of  the  methodologies 
developed  to  the  overall  effort  of  the  Director  for  Quality 
will  be  presented  in  the  final  chapter. 
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8.   DATA  SAMPLE 

Data  was  collected  from  a  sample  of  DA  FAOs,  during  the 
period  January  1980  through  June  1981.   The  data  submitted 
via  FINOPS  has  only  existed  since  January  1980,  including  the 
FINOPS  test  period,  whereas  the  aggregation  of  JUMPS  transac- 
tion data  has  been  conducted  for  many  years.   The  data 
collected  for  the  purpose  of  analysis  in  this  thesis  dealt 
with  JUMPS  transaction  performance,  which  the  authors  will 
refer  to  as  the  Military  Pay  category.   Within  the  Military 
Pay  category,  the  analysis  was  further  limited  to  three  areas 
as  follows:   the  acceptance  rate  of  pay  change  documents 
processed  during  the  month,  the  percentage  of  late  pay  change 
documents,  and  the  percentage  of  pay  change  document  transac- 
tions submitted  during  the  last  three  JUMPS  update  cycles  of 
the  processing  months.   Military  pay  was  selected  for  analy- 
sis because  of  its  broad  scope:   it  is  an  area  within  the 
finance  and  accounting  operation  which  affects  all  military 
personnel.   In  any  case,  the  lack  of  complete  and  consistent 
data  in  the  other  critical  data  indicators  for  the  13  month 
period  effectively  restricted  the  analysis  to  the  Military 
Pay  category  data.   As  previously  stated  in  Chapter  III, 
FINOPS  implementation  did  not  occur  until  late  1980,  thereby 
precluding  the  development  of  a  complete  13  month  data  base 
in  most  of  the  critical  data  indicators.   The  selection  and 
determination  of  critical  data  indicators  was  (and  still  is) 
a  continuous  and  evolutionary  process,  making  it  virtually 
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impossible  to  collect  consistent  and  common  data  for  other 
than  the  three  critical  data  indicators  for  the  period 
January  1980  through  June  1981. 

In  selecting  the  FAOs  to  be  used  in  the  sample,  it  was 
decided  by  the  authors  that  performance  data  from  FAOs  in 
three  major  commands  (MACOMs),  Training  and  Doctrine  Command 
(TRADOC),  Forces  Command  (FORSCOM),  and  United  States  Army 
Europe  (USAREUR)  would  be  considered.   Other  MACOMs  did  not 
provide  a  large  enough  sample  size  (20  FAOs  in  11  MACOMs)  in 
order  for  the  authors  to  develop  overall  methodologies.   It 
was  felt  by  the  authors  that  the  three  selected  MACOMs  re- 
flected the  mainstay  of  the  DA  FAOs  while  providing  insights 
into  offices  where  the  missions  and  staffing  compositions 
were  clearly  different.   The  FAOs  within  each  MACOM  were 
considered  to  form  a  homogenous  group. 

From  a  population  of  38  FAOs  in  the  three  aforementioned 
MACOMs,  a  sample  size  of  54  (13  from  each  MACOM)  was  randomly 
selected.   It  was  felt  by  the  authors,  that  this  sample  size 
was  sufficient  to  insure  reliability. 


C.   DATA  EXAMINATION 

The  analysis  of  the  data  sample  should  be  performed  in 
accordance  with  generally  accepted  analytical  techniques.   In 
order  to  determine  the  proper  techniques  to  be  utilized,  one 
must  first  examine  the  data  sample.   The  examination  may 
consist  of  various  statistical  tests  for  which  the  results 
will  describe  some  of  the  properties  of  the  data  sample. 
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Performance  data  over  collected  over  a  period  of  time, 
such  as  the  13  month  sample  of  this  analysis,  is  often 
referred  to  as  a  " time- series" .   It  is  of  interest  in  an 
analysis  of  time- series  if  the  data  (ie.  performance)  will 
change  by  a  relatively  constant  amount  over  each  time  incre- 
ment (ie.  monthly).   The  method  utilized  to  determine  this 
constant  change  is  linear  regression  or  linear  trend 
analysis.   The  development  of  a  trend  line  may  not  be  suffi- 
cient to  evaluate  and  predict  performance.   In  determining 
the  usefulness  of  a  regression  equation  or  trend  line,  one 
must  be  cautious  and  consider  other  statistical  factors  and 
tests  of  the  data  sample  in  addition  to  the  development  of 
the  regression  equation.   These  factors  or  tests  include  but 
are  not  limited  to  the  ones  discussed  in  the  following 
sect i  on . 

1 .   Data  Factors  and  Tests 

The  factors  and  tests  discussed  in  this  section  will 
evaluate  the  data  sample  sufficiently  to  determine  its 
suitability  for  regression  or  linear  trend  analysis. 

The  coefficient  of  determination  [r*) ,    which  measu- 
res the  fraction  of  the  total  variation  which  can  be  explain' 
ed  by  the  regression  line,  may  be  used  to  measure  how  useful 
the  regression  line  is  for  predicting  or  forecasting  perfor- 
mance.  The  closer  the  r^  value  is  to  the  value  of  1  (100%) 
the  better.  The  decision  of  what  magnitude  constitutes  a 
satisfactorily  high  value  of  r^  is  largely  judgmental. 
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The  correlation  coefficient  (r),  measures  the  linear 
relationship  between  the  variables  of  the  regression  line.   A 
value  close  to  0  will  lead  one   to  the  conclusion  that  the 
variables  are  not  linearly  related,  whereas  a  value  close  to 
the  value  1  in  magnitude  will  show  strong  linear  relationship 
between  the  variables.   The  correlation  coefficient  is  the 
square  root  of  the  coefficient  of  determination. 

Serial  correlation  of  the  data  sample  is  a  regular 
pattern  displayed  by  the  data  about  the  regression  line. 
Tests  of  serial  correlation  (autocorrelation)  are  often  use- 
ful in  examining  the  randomness  of  data  obtained  in  a  sample. 
A  test  of  serial  correlation  is  the  "Durbin-Watson"  statis- 
tic, which  examines  the  residuals  (error  terms)  in  a 
regression  equation  Interpretation  of  the  Durbin-Watson 
statistic  can  be  found  in  statistical  and  forecasting  texts. 
Another  method  involves  the  determination  of  a  serial 
correlation  coefficient  in  testing  the  null  hypothesis  (H0) 
that  the  population  serial  correlation  coefficient  (p)  is 
equal  to  0.   This  procedure  requires  the  determination  of  a 
critical  value  for  r  (r0)  from  a  table,  and  subsequently 
calculating  the  two  values  for: 

+  r0  -(l*(n-l))  [Ref.   24:   p.  254] 

where  "n"  is  the  number  of  observations  in  the  sample,  to 
depict  the  interval  for  testing  the  correlation  coefficient 
(r)  against  the  null  hypothesis.   If  the  value  for  the 
correlation  coefficient  (r)  is  contained  in  the  interval 
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depicted  by  the  two  computed  values,  then  the  null  hypothesis 
(H0:  p=0)  may  be  accepted  or  one  may  state  that  the  data 
does  not  support  the  existence  of  serial  correlation. 

The  t- statistic  can  be  used  for  testing  certain 
hypotheses  about  the  means  of  (assumed)  normal  distributions, 
such  as  whether  the  population  correlation  coefficient  is 
equal  to  zero.  The  t-statistic  can  also  be  used  to  determine 
confidence  intervals  around  the  sample  estimate  for  the 
population  mean,  such  as  the  confidence  that  a  coefficient  of 
the  regression  equation  is  non-zero.   If  the  test  indicates 
that  one  cannot  be  confident  that  the  coefficient  is  non- 
zero, the  utility  of  the  regression  equation  becomes 
questionable.   In  this  thesis,  a  95%  confidence  level  will  be 
required  for  rejection  of  the  null  hypothesis  that  any 
coefficient  equals  zero.   The  critical  value  from  the 
t-distribution  table  for  ( n - 2  =  16)  degrees  of  freedom  with  a 
level  of  confidence  of  .95  is  2.12.   A  calculated  t-statistic 
less  than  this  will  lead  to  acceptance  (failure  to  reject)  of 
the  null  hypothesis,  whereas  a  value  greater  than  2.12  will 
lead  to  rejection  (failure  to  accept)  of  the  null  hypothesis. 

An  F-test  may  be  used  to  determine  if  one  can  be 
statistically  confident  about  the  strength  of  a  relationship 
between  variables.   The  computed  F-ratio  must  be  compared 
with  the  critical  value  determined  from  an  F-table  for  1  and 
16  degrees  of  freedom  at  a  .05  level  of  significance.  This 
critical  value  is  equal  to  4.49.   Interpretation  of  the 
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comparison  is  as  follows:   if  the  computed  F-ratio  is  larger 
in  magnitude  than  the  critical  value,  then  a  significant 
linear  relationship  may  exist  between  the  variables  or,  one 
may  reject  (fail  to  accept)  the  null  hypothesis  that  there  is 
no  significant  linear  relationship  between  variables;  if  the 
computed  F-ratio  is  smaller  in  magnitude  than  the  critical 
value  from  the  F-table,  then  no  significant  relationship 
exists,  or  one  may  accept  (fail  to  reject)  the  null  hypothe- 
sis.  The  F-test  and  t-test  on  the  regression  coefficient  are 
equivalent  because  the  t-statistic  is  related  to  F  (with  one 
degree  of  freedom  in  the  numerator)  by:   t'  s  F  [Ref.   21: 
p.   421]. 

The  data  sample  for  the  Military  Pay  category  was 
first  examined  through  trend  analysis.   The  results  of  the 
examination  may  be  found  in  Appendix  B,  and  are  summarized  in 
Table  IV-1.   A  review  of  the  coefficients  of  determination 
( r 2 ) ,  and  the  correlation  coefficients  (r)  indicated  that 
very  little  variance  in  the  data  can  be  explained  by  the 
trend  line. 

The  tests  for  serial  correlation  led  to  the  general 
acceptance  of  the  null  hypothesis  ( H  0 )  ,  that  the  population 
serial  correlation  coefficient  was  equal  to  zero.   One 
exception  was  noted  in  the  case  of  the  USAREUR  acceptance 
rate  indicator,  which  strongly  influenced  the  statistic  for 
the  Army -wide  aggregate.   This  event  will  be  examined  in  a 
subsequent  section  of  this  data  examination.   An  interpreta- 
tion of  the  overall  results  of  the  Durb in- Watson  statistics, 
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TABLE  IV-1 


DATA  EXAMINATION  TESTS 


R2 

% 

r 

Serial  C 

orre 

lation 

t-ratio 
cv=2.12 

F-ratio 

n-l 

Durb 

in-Watson 

cv=4.49 

Acceptance 

Rate: 

Army-wide 

15.2 

.39 

reject  H0 

0.85 

2.01 

4.04 

TRADOC 

10.8 

.33 

accept  H0 

0.99 

1.75 

3.06 

FORSCOM 

4.8 

.22 

accept  H0 

2.23 

1.36 

1.86 

USAREUR 

21.0 

.46 

reject  Hn 

0.57 

2.35 

5.53 

Army  (s.a.)*  6.3     .25 


accept  H0 


0.98 


0.97 


0.94 


Late  Pay  Change  Rate: 

Army-wide  0.3  .06 

TRADOC  1.2  .11 

FORSCOM  1.4  .12 

USAREUR  6.2  .25 


accept  H0 

1.78 

1.03 

1.06 

accept  H0 

1.63 

0.43 

0.19 

accept  H0 

1.92 

1.11 

1.24 

accept  H0 

1.45 

1.46 

2.12 

Last  Three  Update  Rate: 

Army-wide  11.0  .33 

TRADOC  12.5  .35 

FORSCOM  13.5  .37 

USAREUR  10.4  .32 


accept  H0 

2.23 

-1.69 

2.36 

accept  H0 

2.30 

-1.77 

3.15 

accept  H0 

2.17 

-1.83 

3.34 

accept  H0 

2.11 

-1.69 

2.86 

Army-wide  data  with   seasonal    adjustment 
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disclosed  that  no  serial  correlation  was  likely  to  exist 
among  the  residuals  with  exceptions  noted  above.   These 
exceptions  indicated  that  positive  serial  correlation  existed 
in  the  residuals  of  the  acceptance  rate  data.   In  this  case, 
the  true  underlying  relationships  among  the  variables  is  not 
expressed  by  the  regression  equation.   The  Durbin-Watson 
statistic  for  TRAOOC  indicated  that  serial  correlation  was 
questionable.   (For  the  graphical  interpretation  of  the 
critical  regions  of  the  Durbin-Watson  statistic,  the  reader 
may  refer  to  Appendix  B.) 

The  examination  of  the  t-stati sties  indicated  that 
the  null  hypothesis  (regression  coefficient  equals  zero) 
would  be  accepted  in  all  but  one  case,  thus  utilization  of 
the  regression  equation  is  questionable.   One  may  conclude 
that  no  statistically  significant  relationship  exists  between 
the  variables  (performance  and  time). 

In  the  presence  of  serial  correlation,  one  can 
frequently  adjust  the  data  sample  to  allow  for  a  better  fit 
to  a  linear  regression  line.   Such  adjustments  are  customari- 
ly made  for  suspected  seasonality  or  cyclical  movements  in 
the  data  sample.   Positive  serial  correlation  was  evident  on 
an  Army-wide  basis  for  the  acceptance  rate  indicator.   The 
authors  suspected  that  a  seasonal  pattern  may  have  been 
evident,  and  subsequently  reevaluated  the  data  sample  after 
adjustments  were  made  for  seasonality.   The  adjustments  were 
made  based  on  a  "three-term"  moving  average  adjustment  for 
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seasonal  variation  [Ref.   24:   p.   419].   The  moving  average 
adjustment  for  seasonality  is  a  smoothing  technique  which  may 
be  used  to  minimize  the  effects  of  seasonal  fluctuations  in  a 
time-series.   The  three-term  moving  average  adjustment  did 
not  result  in  a  significantly  different  Durb in- Watson  statis- 
tic from  the  previous  results  for  the  Army-wide  acceptance 
rate  data  sample,  and  therefore  would  not  increase  the 
confidence  in  the  regression  equation  as  a  predictor  of 
per  for  mance. 

2 .   Tests  for  Assessing  the  Effectiveness  of  DA  QA 

Assistance  visits 

One  of  the  Director  for  Quality's  major  responsibili- 
ties is  to  provide  on-site  assistance  to  field  FAOs  as  the 
need  arises.   Further  examination  of  the  data  sample  will 
test  the  effect  of  a  DA  QA  assisstance  visit  on  the  perfor- 
mance of  a  FAO  and  the  MACOM  as  a  whole.   It  would  be  mean- 
ingful to  1JSAFAC  and  MACOM  decision  makers  to  know  whether  or 
not  performance  as  reflected  in  the  critical  data  indicators 
generally  improves  after  an  assistance  visit.   This  informa- 
tion allows  USAFAC  and  MACOM  managers  to  make  better  deci- 
sions about  the  allocation  of  its  resources.   Intuitively, 
one  might  expect  improved  performance  immediately  after  an 
assistance  visit,  followed  by  a  gradual  decay  in  performance 
and  a  subsequent  period  of  level  performance  at  a  level 
higher  than  prior  to  the  DA  QA  assistance  visit.   Performance 
of  this  nature  is  exhibited  in  Figure  IV-1. 
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It  should  be  emphasized  that  these  tests  do  not 
constitute  a  classical  statistical,  controlled  experiment  to 
conclude  whether  or  not  an    assistance  visit  significantly 
affects  performance.   If  performance  in  one  critical 
indicator  shows  little  or  no  improvement  after  an  assistance 
visit,  then  the  assistance  visit  may  not  be  beneficial  to  the 
FAO  as  far  as  improving  the  performance  measured  by  that 
specific  critical  data  indicator.   However,  it  could  still  be 
that  the  assistance  visits  improve  performance  measured  by 
other  critical  data  indicators  or  improve  FAO  performance  in 
some  aspect  not  now  measured  by  any  critical  indicator. 
Finally,  the  assistance  visit  may  well  prevent  deterioration 
in,  and  help  maintain  the  present  high  levels  of,  performance 
yet  not  show  up  in  an  immediate  post-visit  performance 
increase.   In  other  words,  the  tests  performed  in  this 
research  for  assistance  visit  effectiveness  looked  only  for 
immediate,  positive  reaction  to  the  visit  in  one  critical 
indicator.   If  response  to  the  visit  was  in  other  areas  of 
performance,  or  was  a  long-term,  gradual  response  rather  than 
an  immediate,  abrupt  response,  or  was  non-negative  rather 
than  positive  in  nature,  it  would  not  be  detected  by  the 
tests  descibed  in  this  thesis. 

This  section  will  discuss  two  tests  which  the  authors 
conducted  to  assess  whether  the  OA  QA  assistance  visits  to 
field  FAOs  had  a  significant  effect  on  observed  performance 
data.   The  first  test  compares  the  pre-visit  and  post-visit 
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FAO  performance  means.   The  second  test  subjectively  compares 
the  observed  pre-  and  post-visit  FAO  performance  pattern  to 
the  intuitively  expected  performance  pattern  of  a  FAO,  before 
and  after  undergoing  a  DA  QA  assistance  visit  as  shown  in 
Fi  gur e  I  V-l . 

a.   Test  #1 

The  first  test  for  assessing  the  effectiveness  of 
a  OA  QA  assistance  visit  to  field  FAOs,  attempts  to  identify 
statistically  significant  differences  in  the  pre-visit  and 
post-visit  mean  performances  for  the  individual  FAOs.   The 
pre-visit  mean  is  calculated  from  sample  data  available  for 
two  months  prior  to  the  DA  QA  assistance  visit,  in  addition 
to  the  month  of  the  assistance  visit  (three  months  total). 
The  post-visit  mean  is  calculated  for  the  six  month  period 
subsequent  to  the  month  of  the  assistance  visit. 

If  the  DA  QA  assistance  visits  are  in  fact 
effective  in  improving  the  aspects  of  performance  of  field 
FAOs  which  are  measured  by  critical  data  indicators,  one 
might  expect  to  observe  a  difference  in  the  pre-  and  post- 
visit  mean  performances.   Further,  one  might  expect  that 
post- vis  it  mean  performance  would  be  better  than  the  pre- 
visit  mean  performance.   In  statistical  terms,  the  authors 
will  refer  to  a  situation  where  there  is  no  difference 
between  the  pre-  and  post-visit  mean  performances  as  the 
"null  hypothesis".   The  "alternate  hypothesis"  for  the 
purposes  of  this  test  is  the  situation  where  the  post-visit 
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performance  mean  is  better  than  the  pre-visit  mean  perfor- 
mance 1  eve  1 . 

The  "Student's  t"  distribution  allows  for  the  use 
of  a  "t"  test  to  determine  the  level  of  significance  for  the 
difference  in  means  of  two  populations  [Ref.  21:  p.  208]. 
The  "t"  distribution  involves  using  s,  an  estimate  of  the 
population  variance,  which  is  calculated  from  the  sample.   It 
is  customary  and  acceptable  to  make  the  assumption  that  the 
variances  ar e  not  the  same  for  the  pre-  and  post-visit 
means  when  the  sample  sizes  are  small,  unless  there  is 
evidence  to  the  contrary   [Ref.   21:   pp.   214].   The  unequal 
variance  assumption  will  provide  the  analyst  with  a  more 
conservative  analysis,  a  slightly  larger  confidence  interval, 
and  thus  a   lesser  chance  of  rejecting  a  true  null  hypothesis 
[Ref.   3:   p.   42] 

The  level  of  significance  indicates  the  amount  of 
confidence  one  has  in  rejecting  the  null  hypothesis.   If  the 
"t"  test  is  significant  at  the  .05  level,  one  can  reject  the 
null  hypothesis  with  95%  confidence,  which  means  there  is 
only  a  5%    chance  (or  less)  that  the  null  hypothesis  would  be 
rejected  when  in  fact  there  was  no  difference  in  pre-  and 
post-visit  performance  means.   This  test  is  one  way  by  which 
the  effectiveness  of  DA  QA  assistance  visits  to  field  FAOs 
can  be  assessed. 


73 


b.   Test  #2 

The  second  test  for  assessing  the  effectiveness 
of  DA  QA  assistance  visits,  consists  of  a  graphical  compari- 
son of  intuitive  and  actual  performances  of  the  MACOMs  and 
all  sampled  FAOs  after  a  DA  QA  assistance  visit.   The  intui- 
tive performance  pattern  is  based  on  general  knowledge  of  the 
authors'  perceptions  of  human  motivational  principles  and 
managerial  intuition.   The  performance  o^  each  FAO  may  be 
compared  with  the  intuitive  pre-  and  post-visit  performance 
(Figure  IV-1)  on  an  individual  basis  or  on  an  aggregated 
basis  for  the  MACOM.   If  the  FAO's  pre-  and  post-visit 
performance  pattern  is  similar  to  that  of  the  intuitive 
performance  model,  it  may  be  deducted  that  the  DA  QA 
assistance  visit  was  effective  in  improving  the  performance 
of  the  FAO.   If  pre-  and  post-visit  performance  does  not 
display  the  pattern  exhibited  by  the  intuitive  performance 
model,  then  the  graphical  analysis  will  not  support  any 
conclusions  drawn  to  the  relationship  of  FAO  performance  and 
the  effectiveness  of  the  DA  QA  assistance  visits. 

This  method  of  comparison  is  subjective,  may  be 
less  precise,  and  may  contain  "random  fluctuation"  in  the 
data  great  enough  to  conceal  actual  improvements  in  FAO 
performance,  and  therefore,  be  difficult  to  apply  practical- 
ly.  There  is  one  distinct  advantage  to  the  graphical 
comparison  of  performance  patterns,  in  that  the  subjective 
expertise  gained  by  the  analyst  can  be  utilized  in  areas 
where  quantifiable  statistics  fail  to  reveal  any  significance. 
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c.   Test  Evaluation 

Analysis  of  data  for  the  sample  FAOs  in  the  three 
MACOMs  for  the  period  January  1980  through  June  1981  reflec- 
ted the  results  discussed  in  the  following  sections.   The 
acceptance  rate  critical  data  indicator  was  selected  by  the 
authors  for  these  tests  because  it  was  felt  to  be  the 
performance  measurement  most  likely  to  have  shown  a  change 
attributable  to  the  DA  QA  assistance  visits. 

(1)   Test  #1 .   For  the  comparison  of  pre-visit 
and  post-visit  mean  performance  levels,  TRADOC,  F0RSC0M  and 
USAREUR  sample  FAO  '  s  pre-  and  post-visit  performance  means 
were  calculated.   This  data  is  shown  in  columns  two  and  three 
of  Table  IV-2,  respectively  The  difference  in  the  two  means 
is  shown  in  column  four  of  Table  IV-2.   A  positive  number  in 
this  column  indicates  that  the  post-visit  mean  level  of 
performance  is  higher  than  the  pre-visit  mean  level  of 
performance,  whereas  a  negative  number  indicates  that  the" 
pre-visit  mean  level  of  performance  is  higher.   The 
t-statistic  shown  in  Table  IV-2  was  calculated  using  the 
for  mu 1  a  : 

t  =  ( T]_  -  1(2 )  *  V  s  1  ^ / n  1  +  S22/n£ 
where  7^  and  T?  are  the  post-  and  pre-visit  means 
respectively,  s\^    and  s  2  2  are  the  sample  variances  of 
the  post-  and  pre-visit  means,  and  n  ]_  and  n ?  denote  the 
post-  and  pre-visit  sample  sizes  respectively.  The    degrees 
of  freedom  are  based  on  the  approximation: 
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TABLE    IV-2 


PRE-VISIT    VS.    POST-VISIT   PERFORMANCE   LEVELS 


DSSN       PRE-VISIT     POST-VISIT     DIFFERENCE         T 
MEAN  MEAN  in  MEANS       stat. 


TRADOC 

98.49 

98.65 

0.16 

1.04 

5003 

98.77 

99.37 

0.60 

0.79 

5009 

97.45 

97.50 

0.05 

0.05 

5053 

97.32 

97.91 

0.59 

0.36 

5056 

98.45 

98.58 

0.13 

0.25 

5059 

98.61 

98.50 

-0.01 

-0.07 

*  5074 

99.25 

99.51 

0.26 

1.96 

6325 

- 

- 

- 

- 

*  6339 

98.15 

98.86 

0.71 

3.43 

6340 

98.32 

99.30 

0.48 

0.85 

*  6343 

98.59 

99.00 

0.46 

2.29 

6351 

98.74 

98.94 

0.20 

1.05 

6360 

- 

- 

- 

- 

6367 

98.16 

98.38 

0.22 

0.80 

6380 

98.00 

98.43 

0.43 

1.46 

6388 

99.34 

99.40 

0.06 

0.33 

6392 

- 

- 

- 

- 

0066 

97.95 

98.52 

0.57 

1.18 

0068 

- 

- 

- 

- 

USAREUR 

97.49 

97.15 

-0.34 

-0.87 

5495 

98.57 

95.97 

0.40 

0.28 

5499 

98.20 

99.13 

0.93 

1.43 

5580 

95.65 

97.23 

1.58 

0.45 

5581 

97.97 

97.67 

-0.31 

-0.40 

5588 

94.90 

94.12 

-0.78 

-0.35 

5589 

98.07 

96.93 

-1.07 

-1.64 

6324 

96.40 

94.80 

-1.60 

-1.32 

*  6333 

95.40 

97.29 

1.39 

3.13 

6334 

99.34 

99.40 

0.06 

0.31 

*  6335 

97.50 

98.72 

1.22 

2.91 

6359 

98.07 

97.77 

-0.30 

-0.84 

6387 

97.93 

98.47 

0.53 

1.28 

6393 

97.58 

98.07 

0.49 

1.20 

6458 

97.49 

97.97 

0.48 

0.93 

6459 

98.49 

98.83 

0.34 

0.82 

6545 

98.11 

97.83 

-0.28 

-0.38 

6579 

97.47 

96.37 

-1.10 

-1.52 

6583 

97.27 

97.29 

0.02 

0.05 

*    - 


=   improved  performance  @  95%  confidence  level 
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TABLE    IV-2 


PRE-VISIT    VS.    POST-VISIT   PERFORMANCE   LEVELS 


DSSN       PRE-VISIT     POST-VISIT     DIFFERENCE         T 
MEAN  MEAN  in  MEANS       stat. 


FORSCOM 

97.43 

98.03 

0.06 

1.21 

5002 

97.93 

- 

- 

- 

5008 

99.07 

98.88 

-0.19 

-0.67 

5058 

- 

- 

- 

- 

5066 

91.77 

99.27 

7.50 

1.04 

5071 

98.20 

98.30 

0.10 

0.31 

5072 

99.23 

98.95 

-0.28 

-2.80 

5073 

96.77 

98.33 

1.56 

1.11 

5082 

- 

- 

- 

- 

5086 

98.30 

98.08 

-0.22 

-0.33 

5409 

99.83 

99.70 

-0.13 

-0.69 

5486 

96.47 

96.13 

-0.34 

-0.41 

5493 

96.23 

95.58 

-0.65 

-0.47 

5579 

96.73 

97.66 

0.93 

1.16 

6363 

97.80 

97.90 

0.10 

0.22 

6383 

98.60 

98.73 

0.13 

0.51 

6385 

- 

- 

- 

- 

6396 

- 

- 

- 

- 

6416 

97.13 

98.17 

1.04 

1.84 
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d.f.  = 


C(si2/ni)  +  (s22/n2)] 
(si2/ni)2  +  (s22/n2)^ 


(  nx-1 )       (n2-D 
from  which  critical  t- values  should  be  determined  using  a 
t-distribution  table,  for  comparison  to  the  above  calculated 
t- statistic.   [Ref.   3:   pp.   141-142] 

As  previously  stated,  a  95%  confidence  level 
was  used  for  rejection  of  the  null  hypothesis.   At  the  95% 
confidence  level,  three  TRADOC  FAOs  (5074,  6339,  and  6343) 
and  two  USAREUR  FAOs  (6333  and  6335)  may  be  said  to  have 
improved  performance  attributable  to  the  DA  QA  assistance 
visit.   If  the  required  confidence  level  for  rejection  of  the 
null  hypothesis  were  to  be  relaxed  (i.e.   35%),  the  value  of 
the  t-statistic  would  be  lesser  in  magnitude  and  consequently 
more  FAOs  could  be  considered  to  have  improved  performance 
attributable  to  the  DA  QA  assistance  visits.   It  may  be  of 
interest  to  note  that  the  t-statistic  of  the  MACOMs'  compo- 
site data  indicated  that  the  null  hypothesis  may  not  be 
rejected  at  the  95%  confidence  level. 

( 2 )   Test  #2 .   This  test  consisted  of  a  graphical 
comparison  of  the  pre-  and  post-visit  performance  of  the 
MACOMs  and  individual  sample  FAOs  to  the  "intuitive"  model 
shown  if  Figure  IV-1.   This  comparison  allows  one  to  identify 
FAOs  in  which  improved  performance  may  be  reasonably 
attributed  to  the  DA  QA  assistance  visits.  The  performance 
patterns  of  the  MACOMs  and  the  FAOs  identified  in  Test  §  1  as 
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having  improved  performance  attributable  to  the  DA  QA 
assistance  visits  ar e  portrayed  in  Figures  I  V  -  2  through  IV -  7 . 
Additionally,  one  additional  FAO '  s  (DSSN  5538)  pre-and  post- 
visit  performance  pattern  is  shown  in  Figure  I V -  7  to  illus- 
trate a  typical  pattern  for  the  many  FAOs  not  identified  by 
Test  #1  as  showing  a  response  (note  the  scalar  differences). 
It  should  be  noted  that  this  procedure  of  graphical 
comparison  has  some  inherent  caveats  in  its  application. 
First,  the  critical  data  may  practically  be  unchanged 
eventhough  graphical  portrayal  of  performance  indicates  some 
improvement.   Second,  the  critical  data  indicator  of  JUMPS 
acceptance  rate  has  yery    little  practical  room  for  improve- 
ment (i.e.  how  much  better  than  9  8",  acceptance  can  one 
r  easonably  expect? ) . 

The  graphical  comparison  of  pre-  versus 
post-visit  performances  does  not  support  the  conclusion  that 
post-visit  performance  is  improved  over  pre-visit  performance. 
3.   Summary  of  Data  Evaluation 

The  examination  of  the  sample  data  has  consisted  of 
various  statistical  tests  which  have  described  the  data 
sample  sufficiently  for  the  authors  to  justify  a  lack  of 
confidence  in  the  application  of  regression  methods  of 
analysis  as  a  measurement  of  performance.   It  may  be  more 
appropriate  in  the  analysis  of  time-series  data  to  evaluate 
the  sample  by  methods  described  in  texts  as  "moving  averages" 
and  "exponential  smoothing". 
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Moving  averages  and  exponential  smoothing  techniques 
generally  require  less  data  than  regression  methods,  and 
computations  can  be  revised  rather  quickly  upon  collection  of 
new  data  points  as  time  progresses.   Among  the  advantages  of 
these  two  methods  are  that  they  are    easy  to  understand  and 
calculate  and  they  have  minimal  data  storage  requirements. 

The  moving  average  method  of  analysis  of  time-series 
data  is  often  used  due  to  the  advantages  previously  stated. 
A  moving  average  is  simply  the  numerical  average  of  the  last 
"  N"  data  points  (e.g.  last  13  months)  which  are  used  in 
making  a  forecast  or  setting  a  performance  standard.   As  the 
name,  moving  average,  implies,  successive  averages  are  compu- 
ted while  moving  along  in  a  time-series.   A  moving  average  is 
a  smoothing  method  for  reducing  the  effects  of  erratic  and 
short-term  movements  in  a  time- series.   However,  by  restric- 
ting the  computation  to  the  N  most  recent  points,  one  can 
predetermine  the  desired  response  to  data  changes.   The 
number  of  terms  used  in  a  moving  average  will  determine  the 
degree  of  smoothness  or  the  responsiveness  to  movements.   It 
is  of  interest  to  note  that  moving  average  techniques  were 
widely  used  by  the  Air  Force  in  the  CHECKPOINTS  program, 
desribed  in  Chapter  II.. 

Exponential  smoothing  techniques  place  more  emphasis 
(weight)  on  current  data  and  less  on  data  of  the  distant 
past.   The  emphasis  is  applied  through  the  use  of  a  smoothing 
constant  (a)  which  weights  the  data  points  by  a  calculation 
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of  a  mathematical  equation.   The  a  term  in  exponential 
smoothing  and  the  "N"  term  in  a  moving  average  method  act 
similarly,  because  a  large  a  and  a  small  N  both  place  the 
higher  importance  (emphasis)  on  current  data. 

The  moving  average  technique  was  selected  by  the 
authors,  due  to  its  ease  of  computation  and  wide  usage  in  the 
Air  Force,  for  developing  a  methodology  for  measuring  current 
FAO  performance  and  determining  the  current  network  profile 
to  be  presented  in  the  next  section  of  this  chapter. 

D.   METHODOLOGIES  FOR  PERFORMANCE  ANALYSIS 

The  analyses  described  in  this  section  have  two  primary 
objectives.   The  first  is  to  develop  methodologies  for 
identifying  substandard  performance  by  an  individual  FAO. 
The  second  is  to  develop  a  methodology  which  will  enable  the 
Director  for  Quality,  USAFAC,  to  assess  the  current  health  of 
the  DA  financial  network.   For  the  purposes  of  the  remaining 
sections  of  this  chapter  and  the  recommendations  and 
conclusions  presented  in  Chapter  V,  the  term  "substandard" 
will  generally  refer  to  a  FAO's  frequent  appearance  in  the 
bottom  quartile  of  performances  within  the  MACOM  (different 
interpretations  of  "substandard"  are  used  in  sections  D . 2 . c 
and  D.3  of  this  chapter).   By  definition,  since  the  procedur- 
es utilized  in  two  of  the  alternatives  are  essentially  ones 
which  involve  performance  ranking,  a  bottom  quartile  will 
always  exist.   Occasional  appearance  in  the  bottom  quartile 
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may  be  purely  random  and  not  due  to  any    real  deficiency, 
however  habitual  appearance  in  the  bottom  quartile  would 
support  the  non-random  point  of  view  and  identify  the  FAO  as 
"substandard".   The  habituallity  of  appearance  in  the  bottom 
quartile  on  an  operational  basis  will  be  the  focus  of  the 
following  section.   It  should  also  be  noted  that  substandard- 
ness  is  dynamic  in  that  a  FAO  may  be  identified  as  substand- 
ard during  one  period  and  may  perform  superbly  subsequent  to 
the  identification  as  a  substandard  performing  FAO.   It  is 
recognized  by  the  authors  that  in  order  for  substandar dness 
to  exist,  a  standard  should  first  be  established,  however  the 
above  stated  definition  will  suffice  for  this  research. 

1 .   Establishing  the  Existence  of  a  Substandard  Condition 

In  order  to  develop  a  methodology  for  identifying 
substandard  performance  of  DA  FAOs  ,  the  existence  of  a  sub- 
standard condition  should  first  be  established.   Prior  to 
being  able  to  identify  an  individual  FAO  as  a  substandard 
performer,  one  must  first  answer  the  question;  is  appearance 
in  the  bottom  quartile  simply  an  independent  random  event,  or 
is  there  a  pattern  of  substandard  performance  at  least  for 
some  FAOs?   If  the  performance  of  an  individual  r\0    is 
statistically  independent  from  month  to  month,  then  the 
performance  in  one  month  is  not  in  any   way  related  to  the 
performance  of  any  previous  month  [Ref.  21:  p.   62]. 

For  the  following  analysis,  FAO  performance  will  be 
rank  ordered  for  each  of  the  18  months  in  the  period  January 
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1980  -  June  1981.   The  five  lowest  performing  FAOs  will  be 
identified  on  a  monthly  basis.   (Five  FAOs  correspond  to 
approximately  the  bottom  quartile  of  the  sample  taken  from 
each  MACOM.)   If  appearance  in  the  bottom  quartile  is  an 
independent  random  event  with  constant  probability  of 
occurence  for  all  FAOs,  for  all  months,  then  this  event 
(appearance  in  the  bottom  quartile)  could  be  described  as  a 
bin omi ally  distributed  random  variable. 

The  binomial  distribution  is  a  discrete  distribution 
of  a  variable  which  is  either  a  success  or  a  failure.   One 
should   envision  "n"  independent  "trials",  each  resulting  in 
either  "success"  or  "failure",  with  respective  probabilities 
(1-p)  and  p.   The  total  number  of  failures,  x,  is  then  a 
binomial  random  variable.   The  binomial  probability 
distribution  has  the  distribution  function: 

P(x)  =  (5)px  (l-p)n~x        [Ref.  21:   p.  102] 

The  outcomes  are  required  to  be  either  "successes"  or 
"failures".   In  this  thesis,  "failure"  is  represented  by  a 
FAO  appearing  in  the  bottom  quartile  for  any  particular 
month.   Independence  and  constant  probability  of  failure  must 
be  assumed  for  FAO  performance  from  one  month  to  the  next  for 
the  binomial  distribution  to  hold.   If  FAO  performance  is 
found  to  behave  significantly  differently  from  that  predicted 
by  the  binomial  distribution,  the  assumption  of  independence 
or  constant  probability  (or  both)  must  be  rejected;  in  other 
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words,  there  is  non- r andomness  present  and  the  conditions  the 
authors  have  called  "substandard  performance"  exists  for  some 
FAOs  . 

The  complimentary  cumulative  probability  distribution 
(Table  I V- 3  third  column)  lists  the  probability  any  particu- 
lar FAO  will  appear  in  the  bottom  quartile  more  than  K  times 
out  of  18  if  the  event  behaves  binomially.   For  example,  the 
probability  of  a  particular  FAO  appearing  in  the  bottom  quar- 
tile more  than  ten  times  is  equal  to  .0031,  thus  this  would 
be  a  highly  unlikely  event.   Similarly,  a  FAO  should  appear 
in  the  bottom  quartile  more  than  seven  times  out  of  18  with  a 
probability  of  .0975  or  roughly  10%.   When  an  individual  FAO 
appears  in  the  bottom  quartile  eight  or  more  times,  the 
hypothesis  that  this  event  is  an  independent  random  occurence 
for  that  FAO  can  be  rejected  with  90%  confidence.   Thus  a 
significant  dependent  relationship  would  exists  between 
current  and  past  relatively  poor  performance  for  that 
particular  FAO. 

To  validate  the  definition  of  substandardness  the 
authors  used  historical  data  from  the  period  January  1980  - 
June  1981  for  the  two  MACOMs:   TRAD0C  and  IJSAREUR.   These  two 
MACOMs  were  selected  based  on  the  analyses  of  the  data  sample 
which  indicated  that  TRAD0C  FAO  sample  data  and  USAREUR  FAO 
sample  data  would  provide  the  least  and  most  variance  in 
performance  results,  respectively.   Tables  I V-4  and  IV-5, 
sections  A,  list  the  bottom  quartiles  for  FAOs  within  TRA00C 
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TABLE  IV-3 


BINOMIAL  PROBABILITY  DISTRIBUTION 


(N  =  18) 


P  (  X  =  K  ) 


(  X  >  K  ) 


0 

.0029 

.9971 

1 

.0198 

.9774 

2 

.0647 

.9127 

3 

.1327 

.7800 

4 

.1914 

.5886 

5 

.2061 

.3825 

6 

.1718 

.2107 

7 

.1132 

.0975 

8 

.0599 

.0376 

9 

.0256 

.0120 

10 

.0089 

.0031 

11 

.0025 

.0007 

12 

.0006 

.0001 

13 

.0001 

.0000 
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TABLE     IV-4 


A. 


TRADOC'S    BCTTCy    CUARTILE    BY    MCMH 


JAN    80 

5009 
6392 
6339 
6380 
5059 


FEB  80 

6392 
6325 
6380 
5CC9 
6339 


MAR  80 

0C66 
6392 

6380 
6360 
6367 


APR  80 

5002 
6392 
0C68 
5C56 
5CC9 


MAY  80 

6392 
50C9 

6343 
6351 
6367 


JUN  80 

5059 
5CC9 
6340 
6360 
5056 


JUL  80 

5056 
6392 
5053 
6367 
5009 


AUG  8C 

0066 
5056 
6392 
5009 
6339 


SEP  80 

6367 

5C56 
6392 
5C59 
6340 


GCT  80 

5C52 
6367 
6392 
5C09 
6360 


NOV    80 

50C9 
5056 
6340 
5059 
5053 


DEC  80 

5009 
5053 
6360 
6367 
6292 


JAN  81 

5009 
5053 
0066 
5059 
6380 


FEB  81    MAR  81    APR  61 


5009 
6367 
5053 
6380 
5059 


6380 
5053 
5CC9 
6  3  92 

5C59 


50C9 

6392 
6367 
5C52 

6351 


MAY  81 

6392 

6380 
5009 
6360 
0066 


JUN  81 

0066 
6  3  80 
6367 
6392 

6339 


B. 


TRACCC  OSSNS  TALLIEC  ACCCRCING  TO  NUMBER  OF  TIMES 
CF  APPEARANCE  IN  TFE  BCTTOM  CUARTILE 


DSSN 

5009 
6392 
6367 
5053 
638C 
5059 
5056 
636C 
0066 
6339 
634C 
6351 
5CC3 
6325 
6343 
0068 
5074 
6338 


NIMBER 

15" 

14 
9 
8 

8— J 
7" 
6 
5 
5 

4 — i 
3  — 
2 
1 
1 
1 
1 
0 

o— 


PRC8A8ILITY 

0.0000 
0.0000 

SS  0.C376 
0.C975 
0.C975 
0.2107 
0.3825 

NS  0.5886 
0.5886 
0.7800 
0.9127 
0. C774 
0.9971 

NS  0.9971 
0.9971 
0.9971 
l.COOO 
l.COOO 
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TABLE  IV-5 


LSARELR'S  BCTTC*  GLARTILE  BY  MCNTH 


JAN  80 

5580 
6333 
5589 
5495 
5588 


FEB  80 

5580 
5588 
6333 
5499 
6324 


MAP  80 

5495 
5588 
5580 
5581 
6324 


APR  80    MAY  80 


6582 

558C 
6393 
6359 
6232 


6582 
5588 
5495 
5580 

6323 


JUN  80 

5495 

5588 
6579 
6324 

5589 


JUL  80 

5583 
5495 
6324 
6579 
5580 


AUG  80 

5588 
6324 
5495 
6458 
6579 


SEP  80 

5588 
6458 
6224 
5589 
6223 


CCT  80 

6545 
5499 
6224 
6223 

5588 


NOV  80 

5588 
5495 
6324 
6579 
6359 


OEC  80 

6359 
5495 
6579 
5588 
6367 


JAN  81 

5588 
6579 
5495 
6233 
6583 


FEB  81 

5588 
6324 
6583 
6579 
6393 


MAR  81 


6579 
6459 

6293 
5588 


APR  81 

6224 
558e 
5589 
5495 
6579 


MAY  81 

5495 
6579 
6324 
5580 
5588 


JUN  81 

6579 

5581 
6583 

6324 
5568 


B. 


USAREUR  CSSNS  TALLIEC  ACCORDING  TO  NUMBER  CF  TIMES 
OF  APPEARANCE  IN  BQTTCM  QUARTILE 

DSSN 

5588 
6324 
5495 
6579 
558C 
6333 
6582 
5569 
6359 
6392 
5499 
5581 
6456 
6387 
6459 
6545 
6334 
6335 


NLMBER 

PRCBA8ILI 

17  — 

O.COOO 

13 

0.C001 

11 

ss 

0.CC31 

11  — 

0.G031 

7~ 

0.2107 

7 

MS 

0.2107 

5 

0.5886 

4 — 

0.7800 

3  — 

0.9127 

3 

0.9127 

2 

0.9774 

2 

0.9774 

2 

0.9774 

1 

NS 

0.9971 

1 

0.9971 

1 

0.9971 

0 

l.COOO 

0^ 

l.COOO 
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and  USAREUR  respectively,  by  month.   Sections  B,  of  the  above 
tables,  list  the  total  number  of  times  and  the  associated 
probability  that  each  FAO  appeared  in  the  bottom  quart  i 1 e . 

Sections  3  of  Tables  IV-4  and  I V- 5  further  indicate 
categories  which  depict  the  significance  or  "degree"  of 
s ub standar dness .   For  example,  appearance  in  the  bottom 
quartile  eight  or  more  times  may  be  termed  "significantly 
substandard  (SS)"  because  of  the  probability  of  occurence  of 
10%  or  less.   The  contrary  may  be  said  of  the  FAOs  appearing 
in  the  bottom  quartile  three  or  fewer  times,  termed  "not 
substandard  (NS)",  whereas  the  performance  of  FAOs  appearing 
in  the  middle  of  the  distribution  may  be  termed  "marginally 
substandard  (MS)".   The  MS  FAOs  may  qualify  as  either  SS  or 
NS  in  subsequent  evaluations  of  the  tests  as  time  progresses. 
The  fact  that  five  and  four  FAOs  appeared  in  the  bottom 
quartile  eight  or  more  times  for  TRADOC  and  USAREUR 
respectively,  is  support  for  the  rejection  of  the  random 
hypothesis  at  the  90%  confidence  level  for  these  FAOs.   One 
may  therefore  state  that  sub standar dness  ,  as  defined  by  the 
authors,  exists  for  this  critical  data  indicator. 
2.   Identification  of  Substandard  Performance 

Mow  that  the  existence  of  relative  "substandard" 
performance  has  been  established  it  is  possible  to  develop 
alternative  methods  for  operationally  identifying  which  FAOs 
are  substandard  performers.   "Substandardness"  in  the  prece- 
ding section  was  identified  by  examining  what  amounted  to  the 
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entire  past  history  of  the  critical  data  indicator  for  the 
sample  data.   Such  a  procedure  would  be  of  little  operational 
usefulness.   The  Director  for  Quality,  USAFAC  would  probably 
have  much  less  interest  in  finding  out  who  has  been  substand- 
ard from  the  perspective  of  the  past  few  years,  than  finding 
out  who  j_s  substandard  now.   Still,  as  was  seen  for  the 
majority  of  FAOs  in  the  analysis  in  the  last  section,  mere 
appearance  in  the  bottom  quartile  in  the  most  recent  month  is 
often  not  a  reliable  indication  this  condition  will  persist. 
The  identification  of  the  FAO  on  a  timely  basis  would  be  of 
interest.   This  thesis  will  address  three  alternative  methods 
for  doing  this.   Two  alternatives  are  based  on  the  binomial 
probabiliby  distribution,  whereas  the  third  is  a  graphical 
analysis  of  cumulative  performance, 
a.   Alternative  #1-1 

The  first  alternative  method  identifies  as 
substandard  performers,  all  FAOs  which  appear  in  the  bottom 
quartile  four  or  more  times  during  any  consecutive  six  month 
period.   The  six  month  time  period  was  judged  by  the  authors 
to  be  a  viable  timeframe  for  allowing  relatively  quick 
identification  of  a  substandard  FAO.   This  period  could  be 
lengthened  or  shortened  depending  on  the  desired  degree  of 
responsiveness  to  random  fluctuation.   If  a  FAO  appears  in 
the  bottom  quartile  four  or  more  times  during  any  six  month 
period,  then  from  the  complimentary  cumulative  density  for 
six  trials  it  can  be  stated  with  9  5%  confidence  that  the 
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performance  of  that  FAO  is  not  due  to  random  chance.   The 
table  below  shows  other  possible  combinations  of  trials  and 
failures  for  which  the  complimentary  cumulative  density  most 
closely  approximates  the  95%  confidence  level. 


N 


K 


Pr.  % 


2 

(60.0) 

2 

(33.3) 

3 

(93.3) 

4 

(97.9) 

4 

(95.3) 

5 

(96.5) 

5 

(94.3) 

6 

(94.0) 

8 

(94.0) 

2 
3 
4 
5 
6 
8 
9 
12 
18 


b.  Alternative  #1-2 

The  second  alternative  method  identifies  as 
substandard  all  FAOs  which  appear  in  the  bottom  quartile  for 
three  or  more  consecutive  months.  For  a  binomially  distribu- 
ted random  variable  with  a  probability  of  failure  of  0.23,  a 
run  of  three  successive  failures  has  less  than  a  2  %  chance  of 
occurence,  therefore,  it  can  be- stated  with  98%  confidence 
that  the  relative  poor  performance  of  a  FAO  is  not  random  if 
it  appears  in  the  bottom  quartile  for  three  consecutive 
months.   This  method  has  the  advantage  of  being  able  to 
identify  some  substandard  performers  in  a  quite  short  time 
frame.  It  should  be  especially  effective  in  rapid  identifica- 
tion of  those  operations  which  are  experiencing  a  rapid  decay 
of  per  f or mance  . 

c.  Alternative  #1-3 

The  third  alternative  method  of  identifying 
substandard  FAO  performance  is  a  graphical  analysis  of  the 
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performance  of  each  FAO  over  some  period  to  compare  its 
performance  with  other  FAOs  as  well  as  the  composite   MACOM's 
performance.   This  approach  does  not  depend  on  the  assump- 
tions of  a  binomial  distribution  for  appearance  in  the  bottom 
quartile,  or  even  on  the  concept  of  a  monthly  rankinq  of 
FAOs.   The  preceeding  two  approaches,  and  indeed,  the  authors' 
definition  of  "substandardness",  looked  at  habitually  poor 
performance  in  terms  of  an    ordinal  ranking.   "Bad"  was 
defined  in  terms  of  that  ranking,  but  ignored  the  question  of 
"how  bad".   By  contrast,  this  third  method  ignores  the  number 
of  times  a  FAO  is  "bad"  and  concentrates  on  "how  bad".   A  FAO 
which  is  not  "bad"  very  often  but  when  it  is,  is  very  very 
"bad"  could  not  be  detected  by  either  of  the  prior  two 
methods;  it  may  be  detected  by  this  method.   This  method 
addresses  the  question:   do  we  believe  that  the  mean  perform- 
ances of  the  FAOs  and  the  MACOM  composite  performance  are 
statistically  different? 

This  method  of  presentation  is  based  on  a 
statistical  concept  known  as  "Scheffe's  multiple  comparisons", 
which  utilizes  simultaneous  confidence  intervals  for  all 
FAOs.   A  normal  distribution  of  the  observed  sample  mean 
about  the  true  mean  will  be  assumed,  as  is  customary  [Ref. 
21:   p.  151].   The  comparisons  involve  the  computation  and 
utilization  of  the  pooled  standard  deviation  of  the 
performance  data  of  the  FAOs  being  compared.   The  pooled 
standard  deviation  and  the  uniform  sample  size  insure  that 
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all  confidence  intervals  are  of  equal  width.   An  example  of 
this  approach  can  be  seen  in  Figure  IV- 8.   This  figure  iden- 
tifies the  FAO  by  DSSN  or  the  MACOM  (column  1),  the  FAO's  or 
MACOM's  performance  mean  (column  2),  and  graphically  displays 
the  95",  confidence  interval  about  its  FAO's  or  MACOM's 
performance  mean  (to  the  right  of  column  2).   Interpretation 
of  the  graphical  portion  of  Figure  IV -8  is  as  follows: 

1.  The  FAO's  performance  mean  is  depicted  by  the  "I"  in 
the  middle  of  the  shaded  region. 

2.  The  shaded  region  depicted  by  "********"  represents  the 
95%  confidence  interval  about  the  performance  mean. 

3.  The  upper  and  lower  bounds  of  the  95%  confidence 
interval  are  indicated  by  the  "I"s  at  both  ends  of  the 
interval. 

If  the  mean  of  one  FAO  is  not  overlapped  by  the 
shaded  region  of  the  second  FAO,  it  can  be  stated  that  a 
statistically  discernible  difference  exists  between  the  two 
FAOs'  performance  means.   The  same  comparisons  can  be  made 
between  a  FAO  and  the  MACOM.   An  example  of  the  preceeding 
performance  interpretation  is  clearly  reflected  in  Figure 
IV-8,  between  the  performance  means  of  FAO  A  and  FAO  C. 
There  is  no  overlap  between  the  mean  of  FAO  A  and  the 
confidence  interval  of  FAO  C  ,  which  means  that  there  j_s  a 
statistically  discernible  difference  between  the  performances 
of  FAOs  A  and  C. 

This  method  may  be  applied  for  shorter  period  (i.e.  6 
or  9  months)  for  a  more  responsive  assessment  of  substand- 
ard performance,  or  for  a  longer  period  (i.e.  12,  13,  or  24 
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months)  for  smoother  assessments  of  performance.   The  authors 
recommend  an  18  month  moving  average,  as  that  provides  a 
viable  mixture  of  responsiveness  to  and  smoothing  of  short- 
term  movements  in  the  data  sample.   This  information  would  be 
valuable  to  decision  makers  in  that  it  would  provide  an 
easily  understood  method  for  identifying  FAOs  whose  mean 
performances  over  the  period  of  comparison  ar e  significantly 
below  the  period  mean  performance  level  of  their  MACOM. 
3 .   Development  of  a  Current  Network  Profile 

The  preceeding  sections  of  this  chapter  addressed 
methodologies  for  identifying  substandard  performance  by  an 
individual  FAO.   This  section  will  present  a  method  which 
will  enable  the  Director  for  Quality,  USAFAC,  to  assess  the 
current  "health"  of  the  DA  financial  network. 

The  term  "health"  will  be  used  to  describe  the  over- 
all condition  of  the  FAOs'  composite  performance  in  the 
period  analyzed.   The  "health"  of  the  DA  financial  network 
may  be  ascertained  by  the  Director  for  Quality  after  the 
assessment  of  the  FAOs  and  MACOMs  overall  composite  perform- 
ance in  terms  of  an  established  standard  of  performance  for 
any  or  all  of  the  functional  categories.   Composite 
performance  above  (better  than)  or  on  the  same  level  as  an 
established  performance  standard  will  result  in  the  assess- 
ment of  the  DA  or  MACOM  financial  network  as  "relatively 
healthy",  whereas  performance  below  (worse  than)  an  estab- 
lished performance  standard  would  lead  to  the  assessment  of 

an  "relatively  unhealthy"  network. 
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Quality  assurance  can  be  thought  of  as  a  method  for 
providing  protection  against  a  disaster.   As  stated  by  J.  M. 
Juran  in  his  book  Quality  Planning  and  Analysis,  "the 
protection  consists  of  information.   This  information  serves 
one  of  two  purposes:   a.   To  assure  the  recipient  that  all  is 
well  ...  the  process  is  behaving  normally  ...  the  procedures 
are  being  followed;  b.   To  provide  the  recipient  with  early 
warning  that  all  is  not  well  and  that  some  disaster  may  be  in 
the  making.   Through  this  early  warning  system,  the  recipient 
is  placed  in  a  position  to  take  preventative  action  to  avert 
a  disaster."  [Ref.  7:  p.   516] 

According  to  J.  M.  Juran,  the  appropriate  type  of 
standard  for  the  comparison  of  performance  data,  is  the 
"historical"  standard  [Ref.  7:  pp.  518-525].   The  historical 
standard  can  be  used  to  answer  the  question:   are  we  getting 
better  or  worse9   The  methodology  used  in  this  analysis  for 
the  development  of  the  MACOM  "historical"  standards  consisted 
of  obtaining  the  mean  performances  from  the  13  months  of 
historical  data  (January  1980  -  June  1981)  for  three  of  the 
critical  data  indicators  in  the  Military  Pay  category. 
Historical  standards  suggested  by  this  thesis  are  based  on 
the  moving  average  method,  and  are  derived  by  computing  the 
numerical  average  (mean)  of  the  last  N  data  points  (e.g.  13 
months).   A  brief  discussion  of  moving  averages  and  the 
rationale  for  basing  the  standard  on  a  moving  average  was 
provided  in  section  C.3  of  this  chapter. 
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This  section  addresses  a  methodology  for  identifying 
changes  in  overall  composite  performance  through  the 
development  of  a  MACOM  performance  profile  as  a  standard  of 
performance  and  subsequently  the  graphical  comparison  of  the 
current  month's  performance  to  this  standard  . 

The  term  "current"  for  this  analysis  will  be  the 
period  of  time  as  of  the  latest  (most  recent)  month  for  which 
data  was  reported  and  available,  to  the  authors.   This  meant: 
as  of  June  1981. 

A  graphical  presentation  of  the  FAQs'  current  month 
performances  can  be  compared  with  the  most  recent  13  month 
historical  performance  mean  developed  for  the  MACOM.   Since 
only  18  months  of  data  were  available,  the  authors  compared 
the  current  month  to  the  previous  17  months'  performance 
means.   The  interpretation  of  the  composite  graphical 
presentation  is  the  same  as  the  interpretation  provided  for 
Figure  IV- 8,  and  is  also  based  on  Scheffe's  multiple 
comparisons  of  simultaneous  confidence  intervals. 


E.   METHODOLOGY  EVALUATION 

This  section  will  present  an  analysis  of  the  test  data 
described  in  section  B  of  this  chapter  using  the  methodolo- 
gies developed  in  section  0  of  this  chapter.   The  purpose  of 
this  analysis  is  to  provide  some  assessment  of  the  validity 
and  the  usefulness  of  the  methodologies  developed  for  identi- 
fying substandard  performance  of  field  FAOs  and  assessing  the 
current  health  of  the  DA  financial  network. 
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1 .   Analysis  of  Methodologies  for  Identifying  Substandard 
Performance  of  DA  FAQs 

Three  alternative  methods  were  descibed  in  section 
0.2  of  this  chapter  for  identifying  substandard  performance 
of  field  FAOs.   Data  analysis  for  each  alternative  method 
will  be  presented  separately  within  this  section.   Tables 
I V -4  and  I V-5  addressed  substandard  performances  by  FAOs 
within  their  MACOMs  for  the  13  month  test  period.   Two  FAOs 
within  TRADOC,  DSSNs  5009  and  6392,  appeared  in  the  lowest 
quart  i 1 e  15  and  14  times,  respectively,  during  the  test 
period.   Additionally,  two  FAOs  within  USAREUR,  DSSNs  5538 
and  6324,  appeared  in  the  bottom  quartile  17  and  13  times 
respectively.   The  probability  that  this  could  have  happened 
due  to  random  chance  is  essentially  zero  in  all  cases. 
Clearly,  these  would  be  considered  "substandard"  performers 
within  their  respective  MACOMs  for  the  13  month  test  period 
of  analysis.   Besides  these  four  FAOs,  five  additional  FAOs 
were  identified  as  being  substandard  with  90%  confidence. 
These  FAOs  were  identified  as  "significantly  substandard 
(SS)"  in  Tables  I V- 4  and  IV-5.   This  appearance  in  the  bottom 
quartile  an  excessive  number  of  times  was  taken  as  a  defini- 
tion of  substandard  performance  for  the  purposes  of  this 
research.   The  relative  performance  of  each  of  the  three 
alternatives  described  for  operational  identification  of 
substandard  performance  will  be  described  below  in  terms  of 
how  accurately  the  alternatives  identified  these  nine 
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relatively  poor  performers  and  how  soon  the  alternative  made 
the  identification. 

a.   Alternative  #1-1 

As  described  earlier,  this  alternative  identifies 
as  substandard  any  FAO  which  appeared  in  the  bottom  quartile 
four  or  more  times  during  any  consecutive  six  month  period. 
Using  this  criterion,  TRADOC  had  seven  FAOs  qualify  to  be 
identified  as  substandard  performers  during  the  18  month  test 
period.   Six  USAREUR  FAOs  qualified  to  be  identified  as 
substandard  performers  during  the  18  month  test  period. 
These   FAOs  are  annotated  in  Table  IV-6  in  accordance  with 
the  previous  identification  of  SS,  MS,  or  N S  categories  to 
compare  the  results  of  the  alternative  with  the  cumulative 
binomial  probability  categorization  of  section  0.1  This 
comparison  will  determine  if  the  FAOs  were  accurately 
identified  as  substandard.   Alternative  #1-1  resulted  in  the 
correct  identification  of  all  n~ine  of  the  " SS"  categorized 
FAOs.   This  alternative  also  identified  four  "MS"  categorized 
FAOs  as  substandard.   It  is  noteworthy  that  three  of  the  "MS" 
FAOs  appeared  in  the  bottom  quartile  seven  times,  and  one  FAO 
appeared  in  the  bottom  quartile  six  times.   In  other  words, 
these  FAOs  were  in  the  bottom  of  the  "MS"  category.   This 
alternative  requires  a  minimum  of  six  months  to  determine 
substandardness,  therefore,  the  months  of  detection  range 
from  5  to  13  months.   The  results  of  this  alternative  are 
summarized  in  Table  IV-6.. 
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TABLE    IV-6 


IDENTIFICATION   OF  SUBSTANDARD   PERFORMERS 


DSSN  ALT.   #1  ALT.   #2  ALT.   #3 


TRADOC 

5003 

NS 

- 

- 

- 

5009 

SS' 

YES 

6  * 

YES 

6 

YES 

13 

5053 

SS 

YES 

12 

YES 

12 

YES 

18 

5056 

MS 

YES 

8 

YES 

8 

- 

5059 

MS 

YES 

14 

YES 

15 

- 

5074 

NS 

- 

- 

- 

6325 

NS 

- 

- 

- 

6339 

MS 

- 

- 

- 

6340 

MS 

- 

- 

- 

6343 

NS 

- 

- 

- 

6351 

NS 

- 

- 

- 

6360 

MS 

- 

- 

- 

6367 

SS 

YES 

10 

YES 

10  . 

- 

6380 

SS 

YES 

17 

YES 

3 

- 

6388 

NS 

- 

- 

- 

6392 

SS 

YES 

6 

YES 

3 

YES 

13 

0066 

MS 

- 

- 

- 

0068 

NS 

- 

- 

- 

USAREUR 

5495 

SS 

YES 

6 

YES 

7 

YES 

18 

5499 

NS 

- 

- 

- 

5580 

MS 

YES 

6 

YES 

3 

YES 

18 

5581 

NS 

- 

- 

- 

5588 

SS 

YES 

6 

YES 

3 

YES 

13 

5589 

MS 

- 

- 

- 

6324 

SS 

YES 

7 

YES 

8 

YES 

18 

6333 

MS 

YES 

6 

- 

- 

6334 

NS 

- 

- 

- 

6335 

NS 

- 

- 

- 

5359 

NS 

- 

- 

- 

6387 

NS 

- 

- 

- 

6393 

MS 

- 

- 

6458 

NS 

- 

- 

- 

6459 

NS 

- 

- 

- 

6545 

NS 

- 

- 

- 

6579 

SS 

YES 

11 

YES 

8 

- 

6583 

MS 

- 

- 

- 

*  denotes  the  month  of  detection 
as  a  substandard  FAO 
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b.  Alternative    #1-2 

This  alternative  identified  as  substandard 
performers  any  FAO  which  appeared  in  the  bottom  quartile  for 
three  consecutive  months.   Using  this  criterion,  TRADOC  had 
seven  and  USAREUR  had  five  FAOs  identified  as  substandard 
performers  during  the  13  month  test  period  by  Alternative 
#1-2.   The  comparison  with  the  previously  identified 
categories  of  SS,  MS,  and  N S  resulted  in  the  correct 
identification  of  all  nine  of  the  "SS"  categorized  FAOs. 
This  method  also  identified  three  "MS"  categorized  FAOs  as 
substandard,  two  with  seven  and  one  with  six  appearances  in 
the  bottom  quartile.   This  alternative  can  identify 
substandardness  in  a  three  month  period,  therefore  the  month 
of  detection  can  range  from  3  to  13  months.   Results  for 
TRADOC  and  USAREUR  are  summarized  in  Table  IV-6. 

c.  Alternative  #1-3 

This  alternative  identified  as  a  substandard 
performer  any  FAO  whose  mean  performance  level  for  the  18 
month  test  period,  was  significantly  below  the  MACOM 
composite  mean  level  of  performance  based  on  Scheffe's 
multiple  comparisons  concept.   TRADOC  had  three  FAOs,  those 
with  DSSNs;  5009,  5053,  and  6392,  qualify  to  be  identified  as 
substandard  performers  by  this  alternative.   The  TRADOC 
performances  are  graphically  presented  in  Figure  IV -9.   Note 
that  there  is  no  overlap  between  the  performance  means  of  the 
three  substandard  FAOs  and  the  95%  confidence  interval  of  the 
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TRADOC  performance  mean.   Four  USAREUR  FAOs  qualified  to  be 
identified  as  substandard  performers  using  this  alternative. 
Figure  IV-10  clearly  shows  that  FAOs  with  DSSNs  5495,  5580, 
5588,  and  6324  would  be  identified  as  substandard. 

Additionally,  the  comparison  of  the  previously 
identified  categories  of  SS,  MS,  and  NS  with  the  above 
graphical  alternative  resulted  in  the  correct  identification 
of  three  of  five  of  the  previously  categorized  "SS"  FAOs  in 
TRADOC,  three  of  four  in  USAREUR,  and  the  identification  of 
one  "MS"  categorized  FAO  in  USAREUR. 

It  is  of  interest  to  note  that  OSSN  5580  within 
USAREUR  was  previously  identified  by  the  binomial  distribu- 
tion as  "marginally  substandard"  having  been  in  the  bottom 
quart i 1 e  seven  out  of  13  months  (there  is  a  21%  chance  of 
seven  or  more  failures  out  of  13  trials),  it  was  however 
identified  as  substandard  by  each  of  the  three  alternative 
methods  presented  in  this  section. 

Since  this  alternative  evaluates  performance  over 
a  period  of  13  months,  the  month  of  detection,  as  annotated 
in  Table  I V-6 ,  will  not  be  until  month  13.   Results  of  this 
alternative  are  summarized  in  Table  I V - 6 . 
d.   Comparison  of  Results 

Comparison  of  the  three  alternatives  disclosed 
that  Alternatives  #1-1  and  #1-2  produced  quite  similar 
outcomes  in  identifying  substandard  performances  by  F^Os  (12 
FAOs  were  detected  by  both  alternatives).   It  is  of  interest 
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to  note  that  all  FAOs  identified  by  Alternative  #1-3  were 
identified  by  Alternative  #1-2,  and  that  Alternative  #1-1 
identified  all  of  the  FAOs  identified  by  Alternative  #1-2, 
thus  all  by  Alternative  #1-3.   The  first  two  alternatives 
also  produced  similar  results  in  the  area  of  timeliness  of 
identification  of  substandard  performance.   Alternative  #1-1 
detected  three  FAOs  before  Alternative  #1-2,  whereas 
Alternative  #1-2  detected  five  FAOs  before  Alternative  #1-1 
(four  FAOs  were  detected  in  the  same  month  by  both 
alternatives) . 

Although,  Alternative  #1-2  was  initially  thought 
to  have  promise  as  being  a  quicker  method  for  identifying 
substandard  performances  than  Alternative  #1-1,  the  results 
of  the  trial  application  did  not  provide  strong  support  for 
such  a  conclusion.   It  should  be  noted  that  due  to  the 
author-selected  13  month  moving  average  method  utilized  for 
Alternative  #1-3,  timeliness  of  identification  of  substandard 
performances  by  this  alternative  was  not  competitive  with  the 
months  of  detection  for  the  first  two  alternatives. 
Alternative  #1-3   does,  however,  have  its  own  advantages  as 
described  in  section  D.2. 

2 .   Analysis  of  the  Methodology  for  the  Assessment  of  the 

Current  Financial  Network  Profile 

The  methodology  for  the  development  of  the  current 
financial  network  profile  facilitates  the  assessments  of 
MACOM  performance  profiles  and  the  current  (monthly)  "health" 


no 


of  the  financial  network.   The  data  analyzed  for  the  test 
period  January  1980  -  June  1931  was  used  to  calculate  the 
performance  means  for  each  MACOM  and  DA-wide.   Since  the  data 
sample  was  for  18  months,  and  current  performance  (June  1981) 
was  to  be  measured  against  the  historical  means,  the  authors 
used  17  months  for  the  calculation  of  the  historical  means. 
The  historical  means  for  the  Military  pay  category  reflected 
the  results  which  are  presented  in  the  following  section, 
a.   JUMPS  Transactions  Acceptance  Rates 

The  analysis  of  historical  data  disclosed  that 
there  were  significant  statistical  differences  in  the  MACOM 
historical  performance  means  between  TRADOC  and  F0RSC0M, 
TRADOC  and  USAREUR,  and  F0RSC0M  and  USAREUR.   This  is  graph- 
ically represented  by  Figure  IV-11.   Figures  IV-12,  13,  and 
14   graphically  identify  the  current  month  performances  of 
FAOs  above  and  below  the  MACOM  '  s  95%  confidence  interval 
about  the  historical  mean.   The  graphical  comparison  of 
current  (June  1931)  performance  data  with  the  MACOM  histori- 
cal mean  disclosed  that  there  were  statistically  significant 
differences  between  the  current  month  performance  means 
(denoted  graphically  by  dotted  lines)  of  FAOs  within  TRADOC, 
F0RSC0M  and  USAREUR,  and  the  MACOM  historical  means.   The 
results  of  the  comparisons  can  be  interpreted  as  follows:   In 
the  case  of  F0RSC0M,  one  can  state  that  the  current  FAOs1 
performance  mean  was  lower  (worse)  than  the  95*  confidence 
interval  of  the  MACOM  historical  mean.   This  situation  was 
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primarily  caused  by  two  FAOs  whose  acceptance  rates  were 
below  the  95%  level.   In  the  case  of  TRADOC  and  USAREUR,  the 
current  (June  1981)  performance  profiles  exhibit  performance 
means  of  the  FAOs  which  were  statistically  higher  (better) 
than  the  MACOM's  historical  mean. 
b.   Late  Pay  Change  Rates 

The  analysis  of  the  historical  data  disclosed 
that  there  were  significant  statistical  differences  between 
al 1  of  the  MACOMs'  mean  performances  for  the  13  month  period. 
The  late  pay  change  rate  is  an  indicator  in  which  the  better 
performance  is  reflected  by  a  lower  percentage.   The  graphi- 
cal representation  of  the  historical  performance  mean  indica- 
ted that  TRADOC  exhibited  a  significantly  lower  (better) 
historical  performance  mean  than  both  FORSCOM  and  USAREUR, 
and  that  FORSCOM  exhibited  a  statistically  significant  lower 
(better)  performance  mean  than  USAREUR  (Figure  IV-15). 

The  comparison  of  current  (June  1981)  performance 
data  with  the  MACOM  historical  performance  mean  indicated 
that  no  statistically  significant  differences  in  performance 
existed,  for  the  current  month,  between  FAOs  and  their 
MACOM's  historical  mean.   The  graphical  presentations  in 
Figures  IV -16,  17,  and  13  identify  the  performances  of  FAOs 
within  each  MACOM,  which  performed  above  (bad)  and  below 
(good)  the  MACOM's  95%  confidence  interval  about  the 
historical  mean.   The  current  performance  profiles  indicate 
little  relative  change  from  the  MACOM  historical  mean. 
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c.   Last  Three  Update  Rate 

The  analysis  of  historical  data  of  this  data 
indicator  disclosed  that  there  was  a  statistically  signifi- 
cant difference  between  the  MACOM  historical  performance 
means  for  TRADOC  and  FORSCOM.   The  last  three  update  rate  is 
an  indicator  in  which  better  performance  is  reflected  by  a 
lower  percentage.   The  composite  graphical  representation  in 
Figure  IV- 19  indicates  that  the  TRADOC  historical  performance 
mean  is  lower  (better)  than  FORSCOM's. 

Additionally,  the  comparison  of  current  perform- 
ance data  with  the  MACOM  historical  performance  means  disclo- 
sed that  in  a  1 1  three  cases  a  statistically  significant 
difference  existed  between  the  current  month  performance 
means  of  the  FAOs  within  the  MACOMs  and  the  MACOM's  histori- 
cal performance  mean  (Figures  IV-20,  21,  and  22).   The 
figures  graphically  identify  the  FAO's  current  month's 
performances  above  (bad)  and  below  (good)  the  MACOM  9  5% 
confidence  interval  about  the  historical  mean  performance  The. 
results  of  the  comparisons  can  be  interpreted  as  follows: 
the  current  (monthly)  performance  profiles  indicate  that  the 
composite  "current"  profile  of  all  FAOs  within  each  MACOM 
significantly  exceed  (better  than)  the  MACOM's  historical 
performance  mean.   If  this  situation  continues  in  the 
following  months,  each  MACOM  will  experience  movement  toward 
improved  performance  for  this  data  indicator.   If  this 
situation  continues  in  a  1 1  the  MACOMs,  then  movement  toward 
improved  DA- wide  performance  may  exist. 
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F.   SUMMARY 

In  this  chapter  the  authors  described  the  data  sample 
used  for  analyses:   three  critical  data  indicators  from  the 
Military  Pay  category  for  the  13  month  period  of  January  1980- 
June  1981,  for  three  MACOMs  each  consisting  of  13  randomly 
sampled  FAOs.   The  data  sample  was  examined  for  statistical 
properties,  which  determined  the  type  of  analytical  model  to 
be  used  in  the  further  analyses  of  the  data.   The  data  sample 
was  tested  to  assess  the  effectiveness  of  DA  QA  assistance 
visits.   Methodologies  were  descibed  for  operationally 
identifying  substandard  performances  of  DA  FAOs,  and  for 
enabling  the  Director  for  Quality,  USAFAC  to  assess  the 
current  health  of  the  financial  network. 

Two  tests  were  performed  for  assessing  the  effectiveness 
of  DA  QA  assistance  visits  to  field  FAOs. 

1.  Test  #1  -  perform  the  "t-test"  for  statistically  signi- 
ficant differences  in  the  post-visit  versus  .pre-visit 
mean  performances  for  the  individual  FAOs  and  the  MACOM 
composite  means. 

2.  Test  #2  -  graphically  compare  the  FAOs'  and  MACOMs' 
pre-and  post-visit  performance  to  the  intuitive  trans- 
visit  performance  model. 

The  sample  data  for  the  FAOs  of  the  three  MACOMs  was  used 

to  test  the  effectiveness  of  the  DA  QA  assistance  visits  on 

the  one  critical  data  indicator:   JUMPS  transactions 

acceptance  rates,  with  the  following  results:   Test  #1  showed 

that  the  DA  QA  assistance  visits  improved  the  performance  for 

only  five  of  54  FAOs  at  the  95%  confidence  level;  Test  #2 

disclosed  that  none  seemed  to  show  a  significant  improvement 
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attributable  to  the  DA  QA  assistance  visit.   The  pre-  and 
post-visit  performance  patterns  of  the  FAOs  identified  by 
Test  §1    were  illustrated  for  comparison  to  the  intuitive 
trans-visit  model.   The  tests  did  not  establish  the 
effectiveness  of  assistance  visits  but,  as  was  pointed  out, 
by  nature  of  their  design  the  tests  could  not  establish  lack 
of  effectiveness. 

To  identify  substandard  performances  of  DA  FAOs,  three 
alternative  methods  were  developed: 

1.  Alternative  #1-1  -  identify  as  substandard  performers 
all  FAOs  which  appear  in  the  monthly  bottom  quartile, 
four  or  more  times  during  any  six  month  period. 

2.  Alternative  #1-2  -  identify  as  substandard  performers 
all  FAOs  which  appear  in  the  monthly  bottom  quartile, 
for  three  or  more  consecutive  months. 

3.  Alternative  #1-3  -  identify  as  substandard  all  FAOs  for 
which  its  13  month  moving  average  of  performance  is 
statistical ly-discernibly  lower  than  its  WACOM  mean 
performance  for  the  same  period. 

The  data  sample  was  used  to  test  the  alternative  methods 
for  identifying  substandard  performances,  which  were  develop- 
ed in  this  chapter.   The  analysis  revealed  the  following: 
Alternative  #1-1  identified  13  FAOs  as  substandard  perform- 
ers; Alternative  #1-2  identified  12  FAOs  as  substandard 
performers  ;  Alternative  #1-3  identified  seven  FAOs  as 
performing  in  a  substandard  manner.   The  results  of  each 
alternative  were  compared  to  pre- identified  categories  of 
"significantly  substandard",  "marginally  substandard",  and 
"not  substandard"  to  determine  if  the  alternatives  would 
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identify  those  FAOs  which  were  previously  identified  as 
"significantly  substandard".   The  first  two  alternatives 
correctly  identified  all  the  "significantly  substandard" 
FAOs,  whereas  Alternative  #1-3  correctly  identified  six  out 
of  nine  "significantly  substandard"  FAOs.   Additionally,  the 
first  two  alternatives  identified  several  (four  and  three 
respectively)  "marginally  substandard"  FAOs.   Alternative 
#1-3  identified  one  of  the  "marginally  substandard"  FAOs  also 
identified  by  the  other  two  alternatives.   The  analysis  also 
revealed  that  Alternatives  #1-1  and  #1-2  produced  results 
which  were  quite  similar  in  regards  to  timeliness  of 
detection  of  substandard  performances. 

The  methodology  developed  for  assessing  the  current 
health  of  the  DA  financial  network  used  graphical  presenta- 
tions to  compare  the  individual  FAOs'  "current"  month  perfor- 
mance with  the  most  recent  17  month  historical  performance 
mean  for  the  MACOMs.   Finally,  the  data  sample  was  analyzed 
to  graphically  assess  the  "current  health"  of  the  DA  finan- 
cial network.   The  analysis  revealed  the  following:   The 
"current"  month  performance  in  the  "JUMPS  transaction 
acceptance  rate"  indicator  was  above  (better  than)  the 
historical  performance  mean  for  all  three  MACOMs  evaluated. 
The  "late  pay  change  rate"  indicator  disclosed  no  significant 
difference  between  current  performance  and  their  historical 
performance  means  for  any  of  the  three  MACOMs.   All  three 
MACOMs  demonstrated  significantly  better  performance  in  the 

"last  three  update"  indicator. 
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The  next  chapter  of  this  thesis  will  summarize  the 
conclusions  of  this  chapter  and  the  preceeding  chapters. 
Based  on  this  review,  recommendations  for  the  improvement  of 
the  DA  QA  program  will  also  be  presented. 
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V.   CONCLUSIONS  AND  RECOMMENDATIONS 

A.   GENERAL  SUMMARY 

The  purpose  of  this  thesis  was  to  identify  methods  for 
assessing  the  fiscal  performance  of  Department  of  the  Army 
(DA)  Finance  and  Accounting  Offices  (FAOs)  to  assist  the 
United  States  Army  Finance  and  Accounting  Center  (USAFAC), 
Office  of  Field  Evaluation/Analysis  in  the  determination  of 
the  magnitude  and  directional  emphasis  of  the  DA  Financial 
Management  Quality  Assurance  (QA)  Program.  The  objectives 
established  in  Chapter  I  to  achieve  this  purpose  were  to: 

1.  Develop  tests  for  assessing  the  effectiveness  of  DA  QA 
assistance  visits  to  the  field  FAOs. 

2.  Develop  a  methodology  for  identifying  substandard 
performance  by  FAOs. 

3.  Develop  a  method  for  assessing  the  current  health  of 
the  total  DA  financial  network. 

4.  Make  recommendations  for  improvements  to  the  DA  QA 
program  based  on  the  research  and  analysis  performed  by 
the  author  s . 

In  accomplishing  these  objectives,  Chapter  II  provided 

the  background  material  on  the  organization  and  functions  of 

the  DA  financial  network  as  well  as  a  description  of  the  DA 

QA  program.   Chapter  III  provided  definitive  material  on  the 

historical  development  and  current  status  of  the  DA  financial 

management  control  system. 
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Chapter  IV  reported  on  analyses  of  the  data  sample  and 
the  results  of  two  tests  assessing  the  effectiveness  of  DA  QA 
assistance  visits.   It  also  contained  descriptions  of 
methodologies  for  identifying  substandard  performance  by  FAOs 
and  for  enabling  the  Director  for  Quality  to  assess  the 
current  health  of  the  DA  financial  network.   Finally,  Chapter 
IV  reported  the  results  of  analyses  conducted  on  sample  data 
to  determine  the  validity  of  these  methodologies. 

This  chapter  will  summarize  conclusions  as  to  the  utility 
of  the  methodologies  developed  in  Chapter  IV.   It  will  also 
list  recommendations  for  improvements  to  the  DA  QA  program. 


B.   CONCLUSIONS 

The  primary  intent  of  this  research  was  to  develop 
methodologies  which  can  assist  the  Director  for  Quality  in 
determining  the  magnitude  and  directional  emphasis  of  the  DA 
QA  Program.   The  absence  of  a  USAFAC-devel oped  methodology 
for  identifying  substandard  performance  precluded  a  compari- 
son of  results  from  the  USAFAC-devel oped  methods  with  the 
results  obtained   by  the  authors  in  this  thesis.   The 
following  conclusions  drawn  by  the  authors  are  a  result  of 
the  analyses  conducted  in  Chapter  IV  . 

The  tests  performed  for  assessing  the  effectiveness  of  DA 

QA  assistance  visits  disclosed  that  strong  support  for  the 

hypothesis  that  improved  performance  by  FAOs  could  be 

attributed  to  the  DA  QA  assistance  visits,  was  not  evident. 

Two  alternative  methods  were  developed.   The  first  method 
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assessed  effectiveness  by  identifying  statistically 
significant  differences  in  pre-visit  and  post-visit  mean 
performances.   The  second  method  compared  the  actual  pre-  and 
post-visit  performance  pattern  to  an  intuitive  pre-  and 
post-visit  performance  pattern.   This  alternative  has  an 
inherent  weakness  in  that  it  is  largely  a  subjective  process. 
However,  it  has  the  advantage  in  that  the  subjective 
expertise  gained  by  the  analyst  may  enable  the  identification 
and  subsequent  explanation  of  significant  events  not  brought 
forth  by  statistical  tests.   It  is  the  authors'  belief  that 
Test  #1  is  preferable  to  Test  #2,  however,  the  use  of  both 
methods  will  best  enable  the  Director  for  Quality  to  assess 
the  effectiveness  of  DA  QA  assistance  visits. 

The  methodologies  developed  in  Chapter  IV  for  identifying 
substandard  performance  of  FAOs  disclosed  that  substandard 
performance  exists,  and  can  be  identified  through  the 
application  of  these  methodologies.   Through  the  use  of 
sample  data  from  TRADOC  and  USAREUR,  the  authors  tested  the 
three  alternative  methods  developed  for  identifying 
substandard  performance.   The  results  of  these  tests 
identified  13  FAOs  as  substandard  using  Alternative  #1-1,  12 
FAOs  as  substandard  using  Alternative  #1-2,  and  7  FAOs  as 
substandard  using  Alternative  #1-3,  as  compared  to  the  other 
FAOs  in  the  MACOM  and  the  MACOM  composite  performance  mean. 
The  advantage  of  Alternative  #1-1  is  that  it  evaluates 
performance  over  a  "moderate"  six  month  period,  which  the 
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authors  believed  to  be  a  good  choice  to  balance  sensitivity 
and  smoothing.   The  primary  advantage  of  Alternative  #1-2  is 
that  it  may  identify  substandard  performance  more  rapidly 
than  Alternative  #1-1,  if  a  FAO  is  bad  enough  to  show  three 
consecutive  months  of  being  ranked  in  the  bottom  quart  i 1 e . 
Alternative  # I - 3 ' s  strength  is  that,  by  evaluating  perfor- 
mance through  the  use  of  a  moving  average,  it  looks  at  "how 
bad"  a  FAO's  performance  is,  rather  than  just  monthly  ordinal 
rankings.   Clearly,  by  using  the  three  alternatives  in 
conjunction  with  one  another,  the  Director  for  Quality  will 
be  able  to  more  accurately  identify  substandard  FAOs  . 

The  method  developed  to  assess  the  current  health  of  the 
DA  financial  network  disclosed  that  the  objective  assessment 
of  performance  profiles  can  be  made.   Major  Command  (MACOM) 
historical  performance  means  were  developed  for  three  criti- 
cal data  indicators  in  the  Military  Pay  category.   The 
current  performance  of  FAOs  within  the  MACOMs  were  measured 
against  these  historical  means  which  disclosed  that  statisti- 
cally significant  differences  existed  between  "current" 
performance  and  the  historical  data  in  two  of  the  three  cri- 
tical data  indicators.   The  analysis  of  the  third  indicator 
disclosed  that  performance  was  not  different  from  the  histo- 
rical means.   The  utilization  and  application  of  this 
methodology  to  other  critical  data  indicators  will  enable  the 
Director  for  Quality  to  more  accurately  assess  the  "total" 
health  of  the  financial  network  at  both  the  DA  and  MACOM 

levels  of  command . 
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C.   RECOMMENDATIONS 

One  of  the  objectives  of  this  thesis  was  to  make 
recommendations  for  the  improvement  of  the  DA  QA  program. 
This  final  section  will  address  recommendations  for 
improvements  based  on  the  authors'  research  and  analysis 
performed  in  the  preceding  chapters.   Additionally,  this 
section  will  present  some  recommendations  for  future 
consideration. 

The  authors  recommend  that  the  Director  for  Quality  imp- 
lement the  tests  and  methodologies  developed  in  this  thesis 
for  assessing  the  effectiveness  of  DA  QA  assistance  visits, 
for  identifying  substandard  performance  by  FAOs,  and  for 
assessing  the  current  health  of  the  DA  financial  network. 
Implementation  of  these  tests  and  methodologies  will  allow 
the  Director  for  Quality  to  improve  the  DA  QA  program  as 
stated  in  the  following  paragraphs. 

First,  although  not  addressed  in  the  research,  the 
authors  believe  that  the  Director  for  Quality  may  improve  the 
ability  to  determine  the  composition  of  the  DA  QA  assistance 
teams  prior  to  visiting  a  FAO.   Since  FAO  performances  will 
vary  among  critical  data  indicators,  insight  into  the  parti- 
cular weaknesses  of  the  FAO  to  be  visited,  as  reflected  in 
weaknesses  in  particular  critical  data  indicators,  may  help 
the  Director  for  Quality  to  individually  tailor  each  assist- 
ance team  in  accordance  with  the  perceived  and  documented 

(FIMOPS  and  FINES)  needs  of  the  FAO. 
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Second,  the  Director  for  Quality. will  be  able  to  more 
accurately  identify  the  FAOs  in  need  of  assistance  based  on 
utilizing  the  methodologies  developed  for  identifying 
substandard  performances.   The  authors  believe  that  if  the 
Director  for  Quality  is  able  to  more  accurately  determine  the 
directional  emphasis  of  its  assistance  teams  through  the  use 
of  the  developed  methodologies,  then  the  DA  QA  Program  would 
become  more  effective. 

Third,  the  analysis  of  sample  data  in  Chapter  IV  indica- 
ted that  the  DA  QA  assistance  visits  appeared  to  result  in 
improvement  in  the  critical  data  indicator:  JUMPS  trans- 
actions acceptance  rate,  for  only  five  out  of  54  FAOs.   It 
could  not  be  concluded  from  this  analysis  that  assistance 
visits  were  generally  effective  in  i  mpr  ovi  ng  JUMPS  transac- 
tions acceptance  rates.   The  continuous  review  and  analysis 
of  the  results  from  assistance  visits  can  be  utilized  to 
determine  the  responsiveness  of  critical  data  indicators  to 
assistance  visits.   For  example,  analysis  of  DA  QA  assistance 
visits  over  a  period  of  time  may  indicate  that  the  critical 
data  indicator  for  transaction  acceptance  rates  is  in  fact 
responsive  to  assistance  visits,  whereas  the  critical  data 
indicator  for  late  pay  changes  may  not  be  affected  whatsoever 
by  the  visits.   This  type  of  information  would  provide  a 
basis  for  making  improvements  to  the  overall  FAO  performance 
measurement  system  by  evaluating  the  effectiveness  of  the 
assistance  visits  in  terms  of  responsive  indicators  only. 
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Although  not  addressed  by  this  research,  the  authors 
offer  the  following  additional  recommendations  for  future 
consi  der  at i  on: 

1.  The  analysis  of  critical  data  indicators  be  automated 
to  provide  for  timely  feedback  to  the  decision -makers 
at  all  levels  of  command. 

2.  Further  efforts  be  made  toward  the  development  of 
quantifiable  MACOM  and  DA  performance  standards. 

3.  Specific  extended  assistance  be  provided   to  those 
offices  experiencing  continous  substandard  performances 
in  specific  functional  areas,  through  the  DA  QA 

assi  stance  pr  ogr  am. 

4.  Statistical  analyses  be  utilized  in  providing  a 

pr e-assi gnment  presentation  for  Finance  and  Accounting 
Officers  to  be  assigned  to  a  specific  office. 

5.  The  analyses  for  the  identification  of  substandard 
performances  be  utilized  for  prioritization  of 
assistance  visits  to  stations  during  periods  of 
budgetary  constraints. 

6.  A  DA/MACOM  awards  program  for  continuous  superior 
performances  by  FAOs,  be  developed  as  an  incentive  for 
performing  above  the  MACOM  standards. 

7.  Further  research  be  performed  to  determine  the  relative 
importance  of  each  functional  area  and  associated 
indicator,  as  perceived  by  the  Finance  and  Accounting 
Officer,  for  future  correlational  analysis  between 
managerial  profiles  and  operational  performance  of  the 
FAO.   This  relative  scaling  could  further  be  used  in 
consideration  of  assignment  of  managers  to  operations 
with  specific  documented  needs. 
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APPENDIX  A 

THE  FINANCE  AND  ACCOUNTING  OFFICE 

The  internal  organization  and  the  functional  responsibi- 
lities of  the  sections  and  branches  within  the  Finance  and 
Acounting  Office  will  be  presented  in  this  Appendix.   Sources 
of  information  for  this  appendix  were  Army  Regulation  37-101 
and  the  Institute  of  Administration  Special  Text  14-165. 


A.   THE  FINANCE  AND  ACCOUNTING  OFFICER 

The  Finance  and  Accounting  Officer  is  directly  responsi- 
ble to  the  comptroller  and  is  charged  with  maintaining  a 
system  of  accounts  and  financial  procedures  through  which  the 
commander's  responsibilities  are  stated  and  discharged  in 
monetary  terms. 

If  he  is  a  Finance  Corps  officer,  he  is  appointed 
through  command  channels  by  the  major  commander  or  head  of  an 
Army  Staff  Agency.   Authority  for  appointment  may  be  dele- 
gated to  the  installation  commander.   If  he  is  other  than  a 
Finance  Corps  officer  (e.g.,  Department  of  the  Army  (DA) 
civilian),  he  is  appointed  through  the  same  channels,  with 
approval  of  Commander,  US  Army  Finance  and  Accounting  Center. 
Commissioned  officers  are  eligible  for  appointment  as  FAO ' s 
provided  that  they  qualify  under  Specialty  Code  44.   To 

qualify  for  Specialty  Code  44,  an  officer  must  be  able  to 
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perform  various  financial  duties,  have  thorough  knowledge  of 
the  organization  of  the  Army  and  of  Army  regulations  and 
Comptroller  General  decisions  pertaining  to  disbursement  of 
Government  funds,  and  have  a  thorough  knowledge  of  the 
installation  and  operation  of  accounting  and  financial 
statement  analysis.   DA  civilians  appointed  as  Finance  and 
Accounting  Officers  must  also  possess  the  above  qualifications 

The  Finance  and  Accounting  Officer  receives  and  disbur- 
ses public  funds  in  his  own  name.   He  is  held  personally  res- 
ponsible and  pecuniarily  liabe  for  all  that  occurs  or  fails 
to  occur  in  his  office.   A  OA  civilian,  however,  has  certain 
legal  limitations  placed  upon  disbursing  of  public  funds. 

B.   FUNCTIONS  OF  THE  ADMINISTRATIVE  SECTION 

The  administrative  section  provides  overall  administrati- 
ve support  to  the  entire  office.   Its  functins  include  the 
fol 1 owi  ng: 

1.  Processing  all  incoming  and  outgoing  mail. 

2.  Maintaining  central  files  for  all  correspondence  and 
non-accounting  documents. 

3.  Maintaining  a  technical  library  comprised  of  Army 
regulations  and  other  directives. 

4.  Performing  stenographic  and  typing  service  for  the 
operating  elements. 

5.  Requisitioning,  storing,  and  issuing  supplies, 
equipment,  blank  forms,  etc.,  required  to  operate  the 
office  efficiently. 

6.  Preparing  reports  not  of  an  accounting  nature  and 
maintaining  records  and  reports  pertaining  to  the 
civilian  personnel  in  the  office. 
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C.   FUNCTIONS  OF  THE  CENTRAL  ACCOUNTING  OFFICE 

The  Central  Accounting  Office  (CAO)  provides  the  install- 
ation with  professional,  standardized  accounting  and  report- 
ing functions  for  nonappropriated  fund  (NAF)  activities  on 
the  installation,  including  the  installation  club  system. 
Functions  of  the  CAO  include: 

1.  Maintenance  of  accounting  journals,  registers,  ledgers, 
and  subsidiary  accounts. 

2.  Preparation  of  all  disbursement  vouchers  and  checks  in 
payment  of  liabilities  of  all  participating  NAF 
activities. 

3.  Providing  the  activity  managers  with  a  list  of 
disbursements  when  made. 

4.  Maintenance  of  fixed  asset  records. 

5.  Arrangement  for  an  independent  observer  to  witness  and 
attest  to  the  performance  of  required  physical 
inventories,  and  to  observe  the  recording  of 
adjustments  to  the  stock  record  cards. 

6.  Preparation  of  financial  reports  for  all  participating 
NAFs. 

7.  Reconciliation  of  bank  accounts  for  all  participating 
NAFs  and  that  of  the  CAO. 


0.   FUNCTIONS  OF  THE  QUALITY  ASSURANCE  BRANCH 

The  Quality  Assurance  Branch  performs  comprehensive 

audits  of  all  areas  within  the  FAO.   Responsibilities  and 

functions  of  the  Quality  Assurance  Branch  include  the 

f ol 1 owi  ng : 

1.   Developing  a  written,  time-phased  quality  assurance 
plan  of  action,  encompassing  all  functional  areas  of 
the  FAO.   The  plan  should  be  flexible  enough  to  allow 
for  specially  directed  reviews  directed  by  the  Finance 
and  Accounting  Officer. 
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2.  Checking  systems  and  controls  to  insure  proper 
operation. 

3.  Following  work  flow  to  insure  work  force  compliance 
with  regulatory  procedures. 

4.  Insure  report  accuracy  and  compliance  with  financial 
regulations. 

5.  Identifying  existing  and  potential  problem  areas  in 
time  to  permit  remedial  or  corrective  action. 

6.  Prepare  and  submit  reports  of  reviews,  which  contain 
findings  of  deficiencies  and  recommendations  for  their 
resolution. 


E.  FUNCTIONS  OF  THE  QUALITY  EDIT  BRANCH 

The  quality  edit  branch  audits  personnel  financial 
records  of  all  financial  changes  prior  to  entry  into  JUMPS 
and  other  special  audits  in  the  military  pay  area  requested 
by  the  FAO.   It  is  responsible  to  the  FAO  for  all  matter 
pertaining  to  military  pay  administration. 

F.  FUNCTIONS  OF  THE  PAY/EXAMINATION  BRANCH 

The  pay  examination  branch  prepares  and  certifies  all 
disbursement  vouchers,  insuring  that  there  is  sufficient 
evidence  of  entitlement  to  approve  payment.   Certain  other 
vouchers  prepared  elsewhere  are  examined  and  certified  in 
this  br  anch  . 

1 .   Military  Pay  Section 

This  section  processes  vouchers  for  pay  and  allowance 
of  military  personnel  regularly  assigned  to  the  installation 
(but  not  yet  on  JUMPS)  and  those  in  transit  between  stations. 
The  specific  duties  and  responsibilities  of  the  section 
i  ncl ude : 
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a.  Providing  accurate  and  timely  pay  service  to  military 
per  sonnel 

b.  Receiving  and  processing  substantiating  documents 
pertaining  to  pay  accounts. 

c.  Determining  entitlement  of  military  members  to  pay. 

d.  Auditing,  recording,  and  distributing  pay  and  allotment 
forms  . 

2 .  Travel  Sect  i  on 

The  Travel  Section  processes  claims  for  travel 
performed  according  to  written  orders  for  military  members, 
dependents,  and  DA  civilians.   Duties  of  the  section  include: 

a.  Verifying  entitlements  and  computing  amounts  due. 

b.  Computing  the  number  of  days  of  travel  time  authorized 

c.  Computing  travel  advances. 

d.  Maintaining  the  record  of  travel  payments  file. 

3.  Civilian  Pay  Section 

The  civilian  pay  section  maintains  individual  earnings  and 
deduction  records  and  prepares  vouchers  for  payment  of  civilian 
employees.   Some  of  the  specific  duties  are: 

a.  Computing  pay  based  on  properly  authenticated  basic 
r  ecor ds . 

b.  Maintaining  Civil  Service  Retirement  and  Disability  Fund 
records  and  related  controls,  and  preparing  related 

r epor  ts  . 

c.  Maintaining  leave  records  and  the  related  controls. 

4.  Commercial  Accounts  Section 

The  commercial  accounts  section  prepares,  audits,  and 
processes  vouchers  from  commercial  vendors  for  supplies, 
equipment,  and  no n- personal  services.   The  discharge  of  this 
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responsibility  includes  the  following  functions: 

a.  Preparing  and  examining  applicable  vouchers. 

b.  Determining  entitlements. 

c.  Computing  amounts  due  and  discounts  deductible. 

d.  Maintaining  files  of  contracts  concerning  purchases. 


G.   FUNCTIONS  OF  THE  DISBURSING  BRANCH 

The  main  functions  of  the  disbursing  branch  are  to  pay, 
by  check  or  cash,  properly  certified  vouchers  received  from 
the  Pay/Examination  Branch:   to  receive  and  maintain  custody 
over  all  cash  for  which  the  Finance  and  Accounting  Officer  is 
accountable;  and  to  maintain  custody  over  blank  checks  and 
savings  bonds. 

1.   Cash  Sect i  on 

The  cash  sections  makes  all  cash  payments  on  properly 
prepared  and  certified  vouchers  received  from  the  pay  branch. 
It  receives  and  insures  proper  disposition  of  all  cash 
collected  by  the  FAO.   Functions  of  the  section  include: 

a.  Paying  approved  vouchers  by  cash  to  properly  identified 
payees . 

b.  Making  advances  of  cash  to  agent  officers  and  imprest 
fund  cashi  er s . 

c.  Receiving  all  collections  required  for  deposit  with  the 
finance  and  accounting  officer  and  furnishing  the 
depositors  with  receipts. 

d.  Verifying  the  cash  at  the  close  of  each  day  and 
submitting  completed  vouchers  and  remaining  cash  to  the 
chief  of  the  Disbursing  Branch  for  additional  - 
verification. 

e.  Maintaining  the  Cash  Blotter  reflecting  the  status  and 
location  of  cash  in  all  its  forms. 
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2.  Check  and  Bond  Section 

The  checks  and  bond  section  issues  and  accounts  for 
United  States  Treasury  checks  and  Series  EE  Savings  Bonds. 
The  discharge  of  this  responsibility  includes  the  following 
f unct i  ons : 

a.  Maintaining  control  over  all  blank  checks. 

b.  Preparing  checks  for  payment  of  approved  vouchers. 

c.  Forwarding  checks  to  payees  by  mail  or  to  personnel 
authorized  to  distribute  them. 

d.  Maintaining  the  check  register.   The  check  register  is 

a  summary  list  of  Treasury  checks  issued  by  date,  check 
number,  dollar  amount,  and  voucher  number. 

e.  Accounting  for  and  issuing  savings  bonds  procured 
through  cash  purchase  of  civilian  (not  military) 
payroll  deductions. 

3.  Schedu 1 i  ng  Sect i  on 

The  scheduling  section  routes  the  original  and 
duplicate  vouchers  with  the  Statement  of  Daily  Transactions 
to  the- Ac  counting  Branch  for  further  processing.   The 
functions  of  this  section  include  the  following: 

a.  Assigning  and  controlling  collection  and  disbursement 
voucher  s  number  s . 

b.  Preparing  SF  1096  (Schedule  of  Voucher  Deductions).   SF 
1096  contains  a  listing  of  deductions  subtracted  from 
the  gross  dollar  amount  on  disbursement  vouchers. 

c.  Distributing  original  collection  and  disbursement 
vouchers  and  the  Statement  of  Daily  Transactions  to  the 
Analysis  and  Reconciliation  Section,  and  voucher 
duplicates  to  the  Control  Secion  of  the  Accounting 

Br  anch 
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H.   FUNCTIONS  OF  THE  ACCOUNTING  BRANCH 

The  accounting  branch  is  responsible  for  analyzing, 
recording,  summarizing,  verifying,  and  reporting  accounting 
transactions  and  for  maintaining  fund  controls  to  preclude 
overobligation  of  appropriated  funds.   The  accounting 
transactions  include: 

1.  Authorizations  issued  to  the  installation  to  obligate 
appropriated  funds.   These  authorizations  are  called 
installation  allotments. 

2.  Commitments,  an  administrative  reservation  of  funds 
"set  aside." 

3.  Obligations,  a  legal  reservation  of  funds. 

4.  Disbursements  and  collections  by  other  stations. 

5.  Disbursements  and  collections  by  other  stations 
affecting  the  funds  of  the  installation. 

6.  Changes  in  inventory  (receipt  and  issue). 

7.  Accumulation  of  cost  and  fund  data. 

The  accounting  branch  controls  records  needed  to  accura- 
tely reflect  the  financial  transactions  of  the  installation. 
Such  records  generally  consist  of  the  following: 

1.  Gener  al  1 edger . 

2 .  Subsidiary  ledgers. 

3.  File  of  journal  vouchers. 

4.  Files  of  substantiating  documents. 

5.  Machine  listings  prepared  by  the  Data  Conversion  Branch 
from  source  documents. 

Using  these  accounting  records,  the  accounting  branch 

prepares  required  reports  for  higher  headquarters  and  for  use 

by  the  managers  of  the  installation.   The  organizational 
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structure  of  the  accounting  branch  provides  separate  elements 
for  internal  control.   The  independent  functions  of 
obligation  control  and  certification,  document  analysis  and 
control,  recording  and  reporting,  analysis  and 
reconciliation,  and  stock  fund  accounting  are  divided  among 
the  sect  ions. 

1 .   Control  Sect  i  on 

The  control  section  performs  the  following  functions: 

a.  Receives,  analyzes,  and  controls  almost  all  accounting 
documents.   (Main  exceptions  are  original  collection 
and  disbursement  documents  to  A&R  section  and 
commitment  documents  to  the  stock  fund  section.) 

b.  Assigns  type/action  codes  (a  two-digit  code  designating 
a  specific  general  ledger  entry). 

c.  Prepares  most  block  tickets  (cover  sheets  used  to 
control  groups  of  similar  documents).   The  block  ticket 
indicates  the  type  the  routing,  and  the  control  amounts 
for  the  documents  attached. 

d.  Determines  subsequent  actions  to  be  taken  on  accounting 
documents,  and  maintains  progress  charts  reflecting  the 
status  of  block  tickets  and  documents  forwarded  to 
other  sect i  ons  . 

e.  Controls  all  input  and  output  of  accounting  documents 
to  and  from  the  Data  Conversion  Branch. 

f.  Maintains  the  installation's  general  ledger  and 
subsidiary  ledgers. 

g.  Maintains  the  retained  vouchers  file  (a  file  of 
completely  processed  duplicate  accounting  documents, 
which  are  kept  for  reference  purposes.) 

h.   Is  responsible  for  accuracy  of  certain  monthly  reports, 
including  the  Status  of  Approved  Operating  Budget, 
Status  of  Allotment  Report,  Status  of  Reimbursements 
Report,  Miscellaneous  Net  Disbursements  and  Net 
Col  1 ect ions  Report. 
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2.   Accounts  Maintenance  Section 

The  accounts  maintenance  section  certifies  fund 
availability  and  maintains  installation  obligation  files. 
Its  functions  include  the  following: 

a.  Reviewing  all  funding  documents  issued  to  the 
installation. 

b.  Receiving  all  commitment  documents  and  reviewing  them 
for  availability  of  funds,  prior  to  certification  of 
availability  of  funds  by  the  section  or  branch  chief. 
The  sources  of  information  concerning  the  availability 
of  funds  consist  of  the  commitment  register  and  its 
related  files  of  open  commitments.   This  review  is 
essential  to  insure  that  an  over -obligation  of 
resources  does  not  occur. 

c.  Maintaining  files  of  retained  copies  of  approved 
commitment  documents  pending  their  conversion  by  the 
appropriate  agency  into  obligations. 

d.  Receiving  blocks  of  obligation  documents,  eliminating 
the  corresponding  commitments,  and  making  adjustments 
if  the  obligation  does  not  agree  with  the  commitment; 
maintaining  files  of  unliquidated  obligations  and 
verifying  the  total  value  of  documents  in  the  files 
against  the  balances  in  the  applicable  general  ledger 
accounts  on  a  monthly  basis. 

e.  Insuring,  as  far  as  possible,  that  all  valid  obliga- 
tions of  the  installation  have  been  included  in  the 
account i  ng  records . 

f.  Adjusting,  as  required,  all  documents  involving 
obligations  and  accrued  expenditures. 

g.  Maintaining  files  of;  commitment  documents,  undelivered 
contracts  and  orders,  unpaid  contracts  and  orders 
received,  orders  received,  earned  reimbursements. 

h.   Receiving  sales  documents,  maintaining  accounts 

receivable  subsidiary  records,  and  preparing  bills  for 
supplies  and  services  furnished  to  others  by  the 
installation. 
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3.   Analysis  and  Reconciliation  Section  (A&R) 

The  A&R  section  is  responsible  for  verifying  and 
substantiating  the  accounting  data  developed  in  other 
elements  of  the  FAO.   Among  the  functions  are  the  following: 

a.  Analyzing  and  reconciling  accounting  records,  reports, 
supporting  documents,  and  initiating  any  corrective 
action  required. 

b.  Receiving  daily  from  the  disbursing  division  the 
original  disbursement  and  collection  vouchers.  These 
vouchers  are  kept  on  file  in  the  FAO  during  the  month, 
and  forwarded  to  USAFAC  at  the  end  of  the  month.  They 
are  extremely  important  because  as  originals,  they  are 
the  actual  proof  of  changes  in  cash  accountability  for 
the  Finance  and  Accounting  Officer. 

c.  Reconciling  daily  the  figures  shown  in  the  cash  blotter 
and  check  register  (maintained  by  the  disbursing 
branch)  with  adaily  listing  of  collections  and  disbur- 
sements prepared  by  the  Data  Conversion  Branch.   This 
is  known  as  the  "daily  proof  of  cash." 

d.  Reconciling  the  account  balances  in  the  general  ledger 
each  month  with  applicable  supporting  records  during 
the  month . 


Verifying  that  all  valid  obligation  and  expense 
have  been  properly  recorded  during  the  month. 


data 


Reconciling  the  unliquidated  obligations  file  against 
the  allotment  ledgers  at  least  quarterly.   A&R  performs 
a  quarterly  review  of  all  obligations  outstanding  for 
90  days  or  more  and  initiates  follow-up  action  to 
insure  their  validity. 

Preparing  certain  other  reports,  including  (1)  Net 
Expenditures,  Reimbursements,  and  Related  Cash 
Transactions,  (2)  Statement  of  Transactions,  (3) 
Transactions  for  Others  Reports. 

Reconciling  the  Statement  of  Accountability  and 
Statement  of  Transactions  with  other  accounting 
r  epor ts . 

Reviewing  and  reconciling  all  accounting  reports  that 
the  FAO  submits  through  the  installation  comptroller  to 
higher  command . 
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j.   Reconciling  the  quarterly  and  annual  civilian  personnel 
payroll  records  with  general  ledger  accounts  and 
subsidiary  ledgers  pertaining  to  civil  service 
retirement  and  disability,  withholding  taxes,  State 
income  taxes,  and  social  security  taxes. 

4.   Stock  Fund  Sect  i  on 

This  section  maintains  complete  accounting    records 

for  the  stock  fund  located  on  the  installation.   In  addition 

to  maintaining  the  general  and  subsidiary  ledgers,  the 

section  prepares  the  required  stock  fund  reports. 

I.   DATA  CONVERSION  BRANCH 

The  Data  Conversion  Branch  provides  keypunch  and  other 
data  reduction  support  to  all  areas  of  the  Finance  and 
Account i  ng  Of  f i ce . 
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APPENDIX  B 
DATA  EVALUATION  -  REGRESSION 
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CRITICAL  REGIONS 
OF  THE  DURBIN-WATSON  STATISTIC 
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